CN118051164A

CN118051164A - Display method of input method keyboard, electronic equipment and readable storage medium

Info

Publication number: CN118051164A
Application number: CN202211442102.XA
Authority: CN
Inventors: 张哲�
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2022-11-17
Filing date: 2022-11-17
Publication date: 2024-05-17

Abstract

The embodiment of the application provides a display method of an input method keyboard, electronic equipment and a readable storage medium, wherein terminal equipment can acquire data of each user in a target space, and the data of each user comprises the following steps: the position of the user, the furthest operating position of the user; acquiring a data set of an input method keyboard according to the data of each user, wherein the data set of the input method keyboard comprises the data of the input method keyboard of each user; acquiring data of an input method keyboard of a target user in a data set of the input method keyboard, wherein the target user is contained in a user in a target space; and displaying the input method keyboard on a screen of the terminal equipment according to the data of the input method keyboard of the target user, wherein the input method keyboard is positioned at a position on the screen close to the target user and is positioned in the farthest operation position of the target user. The application can provide the input method keyboard which is suitable for the data of the user, and is convenient for the user to accurately operate the input method keyboard.

Description

Display method of input method keyboard, electronic equipment and readable storage medium

Technical Field

The embodiment of the application relates to the technical field of terminals, in particular to a display method of an input method keyboard, electronic equipment and a readable storage medium.

Background

When the user uses the terminal equipment, the user can input the terminal equipment without using an input method keyboard. When the user uses the terminal equipment to navigate, the destination can be input by operating the keyboard of the input method, and when the user uses the terminal equipment to chat, the user can input characters, expression packages and the like by operating the keyboard of the input method.

At present, with the development of terminal equipment, more and more terminal equipment are in scenes such as intelligent driving and intelligent home. Due to the limitation of the use space of the terminal equipment or factors such as the screen size of the terminal equipment, when the user uses the input method keyboard, the user cannot accurately operate the input method keyboard, and even cannot operate the input method keyboard.

Disclosure of Invention

The embodiment of the application provides a display method of an input method keyboard, electronic equipment and a readable storage medium, and a user can accurately operate the input method keyboard.

In a first aspect, an embodiment of the present application provides a method for displaying an input method keyboard, where an execution body of the method may be a terminal device or a chip in the terminal device, and the terminal device is described below as an example. In the method, the terminal device may acquire data of each user in the target space, where the data of each user includes: the location of each user, and the furthest operating location of each user. The target space may be, for example, in a vehicle, home, etc., to which embodiments of the present application are not limited.

After the terminal device obtains the data of each user in the target space, the terminal device can obtain a data set of an input method keyboard according to the data of each user, wherein the data set of the input method keyboard comprises the data of the input method keyboard of each user. In one example, the dataset of the input method keyboard may also include an identification of each user. And acquiring data of the input method keyboard of the target user in the data set of the input method keyboard, wherein the target user is contained in the user in the target space.

The terminal equipment can display the input method keyboard on a screen of the terminal equipment according to the data of the input method keyboard of the target user, wherein the input method keyboard is positioned at a position on the screen close to the target user and is positioned in the farthest operation position of the target user.

In one example, the target user is a user using an input method keyboard, and the terminal device may obtain data of the input method keyboard of the target user in the data set of the input method keyboard in response to an operation of the target user, where the operation of the target user is an operation using the input method keyboard. In an example, the area where the target user gazes on the screen is an area where a preset element exists, and in a case where the distance between the target user and the terminal device is greater than the preset distance, the terminal device may obtain, in the data set of the input method keyboard of the target user, data of the input method keyboard in response to the area where the target user gazes on the screen is an area where a preset element exists. Illustratively, the preset element is an element for triggering the input of text and the like, such as an input box, a voice assistant and the like.

In the embodiment of the application, on one hand, the terminal equipment can display the input method keyboard adapted to the user according to the data of the user, so that the problem that the user cannot operate the input method keyboard is solved, and the user can accurately operate the input method keyboard.

In one possible implementation manner, the data of each user further includes: the arm length of each user, and the shoulder position, obtain the furthest operating position of the user in the target space, including: and acquiring the furthest operation position of the user according to the relative position of the terminal equipment and the user, the arm length of the user and the shoulder position of the user.

In this implementation manner, the terminal device may determine the furthest operating position of the user according to the relative position of the terminal device and the user, the arm length of the user, the shoulder position of the user, and other parameters, so that the terminal device may determine the data adapted to the input method keyboard of the user based on the furthest operating position of the user.

In one possible implementation manner, the obtaining the furthest operation position of the user according to the relative position of the terminal device and the user, the arm length of the user, and the shoulder position of the user includes: according to the arm length of the user and a first preset angle range, a first preset distance farthest from the shoulder of the user is obtained, and the first preset angle range is as follows: the range of the included angle between the big arm and the small arm of the user; acquiring the farthest operation position of the user according to the first preset distance, a second preset angle range, the shoulder position of the user and the relative position of the terminal equipment and the user, wherein the second preset angle range is as follows: a range of operating angles of the user's arm.

In this implementation manner, the terminal device may obtain the farthest operation position of the user on the premise that the user comfortably operates the input method keyboard according to the arm length of the user, the position of the shoulder, and the first preset angle range and the second preset range. On one hand, the method not only can acquire the furthest operation position of the user, but also can ensure the comfort of the operation of the user, and can improve the user experience.

In one possible implementation manner, after acquiring the data of each user in the target space, the terminal device may acquire the data of the input method keyboard of each user according to the data of each user, where the set of the data of the input method keyboard of each user is the data set of the input method keyboard. The data of the input method keyboard of each user comprises the following steps: the position of the input method keyboard of each user in the screen, the size of the input method keyboard and the size of keys in the input method keyboard.

Firstly, the terminal equipment can obtain the position of the input method keyboard of the user in the screen according to the relative position of the terminal equipment and the user, and in addition, the terminal equipment can obtain the size of the input method keyboard of the user according to the position of the screen and the furthest operation position of the user. In this implementation manner, the size of the key in the input method keyboard is a preset size.

In the implementation mode, the terminal equipment can acquire the data of the input method keyboard which is matched with the position of the user and the farthest operation position of the user, and the user can be ensured to accurately operate the input method keyboard.

Secondly, the terminal equipment can acquire the position of the boundary facing the user in the screen, the difference value of the farthest operation position of the user facing the terminal equipment, and the size of the input method keyboard of the user according to the difference value. Illustratively, taking an example that the terminal device is located on the right side of the user, the boundary in the screen of the terminal device facing the user is the left boundary of the screen, and the furthest operating position of the user facing the terminal device can be understood as: the furthest operation position that the user can operate to the right, i.e., the furthest right boundary of the user.

In this implementation manner, when the difference is greater than or equal to a first difference threshold, the width of the input method keyboard of the user is a first width threshold, or the height of the input method keyboard of the user is a first height threshold; when the difference value is smaller than the first difference value threshold and larger than or equal to a second difference value threshold, the width of the input method keyboard of the user is a second width threshold, or the height of the input method keyboard of the user is a second height threshold, the second difference value threshold is smaller than the first difference value threshold, the second width threshold is smaller than the first width threshold, and the second height threshold is smaller than the first height threshold; when the difference value is smaller than the second difference value threshold, the width of the input method keyboard of the user is a third width threshold, or the height of the input method keyboard of the user is a third height threshold, the third width threshold is smaller than the second width threshold, and the third height threshold is smaller than the second height threshold.

When the difference is greater than or equal to the first difference threshold, the furthest position, which represents that the user can operate, is farther, and the width or the height of the input method can be increased appropriately, namely the width of the input method keyboard of the user is the first width threshold, or the height of the input method keyboard of the user is the first height threshold. When the difference is smaller than the first difference threshold and larger than or equal to the second difference threshold, the furthest position which can be operated by the user is limited, and the width or the height of the input method can be reduced appropriately, namely the width of the input method keyboard of the user is a second width threshold or the height of the input method keyboard of the user is a second height threshold. When the difference is smaller than the second difference threshold, the furthest position which characterizes the user to operate is smaller, and the width or the height of the input method can be reduced adaptively so as to ensure the accurate operation of the user.

In the implementation manner, the terminal equipment can acquire the data of the input method keyboard matched with the operation of the user according to the furthest operation position of the user and the position of the boundary of the screen, so that the user can be ensured to accurately operate the input method keyboard.

In one possible implementation, when the difference is greater than or equal to the second difference threshold, the width or the height of all keys or part of keys in the input method keyboard of the user is increased according to the difference. In the implementation manner, since the farthest position which can be operated by the user is far, the width or the height of all keys or part of keys in the input method keyboard can be adaptively increased, so that the user can accurately identify and operate the input method keyboard.

In one possible implementation manner, the data of each user further includes: the inclination angle of each user's sight, the data of each user's input method keyboard still includes: display attributes of keys and backgrounds in an input method keyboard, wherein the display attributes comprise at least one of the following: color, gray scale, brightness, dynamic effect.

In the implementation manner, the terminal equipment responds to the fact that the inclination angle of the sight line of the user is larger than a preset angle, and adjusts display attributes of keys and backgrounds in an input method keyboard of the user.

In one possible implementation manner, the terminal device may further obtain an ambient light level of the target space; and the terminal equipment can adjust the display attributes of keys and the background in the input method keyboard of the user in response to the ambient light brightness of the target space being greater than the preset brightness.

It should be understood that the contrast between the keys in the adjusted input method keyboard and the background is larger, so that the user can accurately identify the keys in the input method keyboard, and the user can accurately operate the input method keyboard conveniently. In the application, the terminal equipment can generate the data which is suitable for the input method keyboard of the user according to the data of the user, and can adjust the display attribute of the keys and the background of the input method keyboard by combining the ambient light brightness which influences the display effect of the input method keyboard, thereby being convenient for the user to accurately distinguish the keys and the background in the input method keyboard and ensuring that the user can accurately operate the input method keyboard.

In a second aspect, an embodiment of the present application provides an electronic device, which may include: a processor and a memory. The memory is for storing computer executable program code, the program code comprising instructions; the instructions, when executed by a processor, cause the electronic device to perform the method as in the first aspect.

In a third aspect, embodiments of the present application provide a computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of the first aspect described above.

In a fourth aspect, embodiments of the present application provide a computer-readable storage medium having instructions stored therein, which when run on a computer, cause the computer to perform the method of the first aspect described above.

The advantages of each possible implementation manner of the second aspect to the fourth aspect may be referred to as the advantages brought by the first aspect, and are not described herein.

In the embodiment of the application, the terminal equipment can acquire the data of the user in the target space in advance, acquire the data of the input method keyboard adapted to the user according to the data of the user, and directly call the data of the input method keyboard of the target user to display the input method keyboard adapted to the target user when the target user executes the operation of triggering the display of the input method keyboard. On the one hand, the input method keyboard which is adapted to the user can be displayed, the problem that the user cannot operate the input method keyboard is solved, the user can accurately operate the input method keyboard, on the other hand, when the terminal equipment does not detect the operation of the target user, the data of the input method keyboard is acquired according to the data of the user, the input method keyboard is generated, the data which is adapted to the input method keyboard of the user is generated in advance, the data of the input method keyboard of the target user is directly called when the target user executes the operation for triggering the input method keyboard, the display speed of the input method keyboard can be improved, and the user experience can be improved.

Drawings

FIG. 1 is a schematic diagram of a usage scenario of an input method keyboard according to an embodiment of the present application;

Fig. 2 is a schematic diagram of a system architecture to which the display method of the input method keyboard according to the embodiment of the present application is applicable;

FIG. 3 is a flowchart illustrating an embodiment of a method for displaying an input method keyboard according to an embodiment of the present application;

FIG. 4 is a schematic diagram of a user's input method keyboard in a scenario provided by an embodiment of the present application;

FIG. 5A is a schematic diagram of an input method keyboard according to an embodiment of the present application;

FIG. 5B is a schematic diagram of another keyboard for inputting method according to an embodiment of the present application;

FIG. 6 is a schematic diagram of another keyboard for inputting method according to an embodiment of the present application;

FIG. 7 is a schematic diagram of another keyboard for inputting method according to an embodiment of the present application;

FIG. 8 is a schematic diagram of another keyboard for inputting method according to an embodiment of the present application;

FIG. 9 is a flowchart of another embodiment of a method for displaying an input method keyboard according to an embodiment of the present application;

fig. 10 is a schematic structural diagram of a terminal device according to an embodiment of the present application;

fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The terminal device (terminal) in the embodiment of the present application may be referred to as a User Equipment (UE), for example, the terminal device may be a mobile phone, a tablet computer (portable android device, PAD), a personal digital assistant (personal DIGITAL ASSISTANT, PDA), a handheld device with a wireless communication function, a computing device, a vehicle-mounted device, or a wearable device, a Virtual Reality (VR) terminal device, an augmented reality (augmented reality, AR) terminal device, a wireless terminal in an industrial control (industrial control), a wireless terminal in a smart home (smart home), or the like, and the form of the terminal device is not specifically limited in the embodiment of the present application.

The input method is a man-machine interaction tool with wide application, and a user can input without using an input method keyboard when using the terminal equipment. For example, when the user uses the terminal device to navigate, the destination can be input by operating the keyboard of the input method, when the user uses the terminal device to chat, the user can input characters, expression packages and the like by operating the keyboard of the input method. With the development of terminal equipment, the application scenes of the terminal equipment are more and more, and due to the limitation of the use space of the terminal equipment, or the large screen size of the terminal equipment, or the limitation of the height of a user, and other factors, when the user uses the input method keyboard on the terminal equipment, the user cannot accurately operate the input method keyboard, so that misoperation is caused, and even the user cannot operate the input method keyboard, so that the user experience is low. It should be understood that the user cannot accurately operate the input keyboard, and can be understood as follows: the user cannot accurately operate the keys in the input method keyboard.

The use cases of several terminal devices are illustrated in fig. 1 to illustrate the case that a user cannot accurately operate an input method keyboard or cannot operate the input method keyboard. As shown in a of fig. 1, when a user uses a car terminal in a vehicle, the user sitting in a front row is inclined with respect to the position of the car terminal due to the restriction of the position of a seat in the vehicle and is at a distance from the car terminal, and when an input method keypad displayed on the car terminal is far from the user of the front row, the user operates inconveniently and the position inclination may cause the user to fail to operate the input method keypad accurately. In addition, the user sitting in the rear row is far away from the vehicle terminal, and cannot operate the input method keyboard displayed on the vehicle terminal.

As shown in b of fig. 1, if the smart screen is used by the user in the smart home scenario, the screen of the smart screen is large, and if the input method keyboard displayed on the smart screen is far away from the user, the user needs to move multiple times to operate the input method keyboard, so that the user is inconvenient to operate. As shown in c in fig. 1, in the smart home scenario, the central control screen is installed on a wall and has a certain height from the ground, if the user is a child, the child is shorter, and if the input method keyboard displayed on the central control screen is far away from the child, the child cannot accurately operate the input method keyboard, and even the problem that the input method keyboard cannot be operated occurs.

The embodiment of the application provides a display method of an input method keyboard, which can be used for installing a sensor in a target space, a terminal device can obtain user data in the target space according to data acquired by the sensor, and the terminal device can adaptively adjust the display attribute of the input method keyboard according to the user data so that a user can accurately operate the input method keyboard. It should be understood that the target space is a space where the user uses the terminal device. Illustratively, the target space may be, for example: in a vehicle, home, etc. The embodiment of the application does not limit the form of the terminal equipment and the target space.

Before introducing the display method of the input method keyboard provided by the embodiment of the application, a system architecture suitable for the display method of the input method keyboard provided by the embodiment of the application is introduced:

Fig. 2 is a schematic diagram of a system architecture to which the display method of the input method keyboard according to the embodiment of the present application is applicable. Referring to fig. 2, the system architecture may include: a terminal device 21 and a sensor 22. In one example, the sensor 22 may be integrated in the terminal device 21. In one example, the sensor 22 may be provided independently of the terminal device 21. In fig. 2, the sensor 22 is illustrated as being provided independently of the terminal device 21.

In one example, the sensor 22 may include: camera and distance sensor.

And the camera is used for acquiring images of the user in the target space.

The distance sensor is used for measuring the distance, and the distance sensor in the embodiment of the application can be used for acquiring the distance between the terminal device 21 and the user. The distance sensor may measure the distance, for example, by infrared or laser light. By way of example, distance sensors such as lidar, millimeter wave radar, etc., and embodiments of the application are not limited in this regard.

In one example, the sensor 22 may include: camera, distance sensor, and ambient light sensor. It should be appreciated that sensor 22 is illustrated in fig. 2 as including a camera, a distance sensor, and an ambient light sensor.

An ambient light sensor for sensing ambient light level.

It should be understood that the location and number of sensors 22 installed in the target space are not limited in embodiments of the application.

The terminal device 21 is configured to obtain data of a user in the target space according to the data collected by the sensor 22, and display an input method keyboard adapted to the user according to the data of the user, so that the user can accurately operate the input method keyboard.

The following describes a display method of an input method keyboard according to an embodiment of the present application with reference to specific embodiments. The following embodiments may be combined with each other, and some embodiments may not be repeated for the same or similar concepts or processes.

Fig. 3 is a flowchart of an embodiment of a method for displaying an input method keyboard according to an embodiment of the present application. Referring to fig. 3, the method for displaying an input method keyboard according to the embodiment of the present application may include:

s301, the terminal equipment acquires the data of each user in the target space.

Sensors in the target space may collect data. Illustratively, a camera in the target space may capture video or images. In one example, the sensor may collect data within the target space at a preset frequency that is greater than or equal to 25hz. It should be understood that, taking the punch speed of the user as an example (e.g., 0.5s-1s punch), when the sensor collects data at a frequency greater than or equal to 25hz, the data collected by the sensor may cover the movement of the user in the target space, so as to achieve the purpose that the terminal device may accurately obtain the data of each user in the target space.

At least one user may be included in the target space. The terminal equipment can acquire the data of each user in the target space according to the data acquired by the sensor. In one example, the user's data may include: the location of the user, and the furthest operating position of the user.

The position of the user can be understood as the three-dimensional coordinates of the user in the target space. It should be understood that the three-dimensional coordinate system in the target space may be preset, and the three-dimensional coordinate of the user in the target space may be understood as the coordinate in the preset three-dimensional coordinate system, and the embodiment of the present application does not limit the setting manner of the three-dimensional coordinate system. For example, if the target space is in a vehicle, the three-dimensional coordinate system in the vehicle may be: the left upper corner of the ground cushion of the main driving position is taken as an original point, the direction of the main driving position towards the auxiliary driving position is taken as an X axis, the direction of the main driving position towards the trunk is taken as a Y axis, and the direction of the ground cushion towards the roof is taken as a Z axis, wherein the X axis is perpendicular to the Y axis, and the X axis and the Y axis are perpendicular to the Z axis respectively.

In one example, the location of the user's preset location may be taken as the user's location. By way of example, the position of the user's eyes may be taken as the position of the user, or the position of the user's head may be taken as the position of the user, or the position of the user's chest may be taken as the position of the user, as embodiments of the present application are not limited in this respect. Because the user operates the input method keyboard or the keyboard seen by the eyes, the position of the eyes of the user can be used as the position of the user in order to more accurately represent the position of the user.

In one example, the terminal device may obtain the location of the user from a video or image captured by the camera. The terminal device may acquire an image including a user and a preset object from a video or an image acquired by the camera, where the image including the user and the preset object may be a frame of image in the video. The preset object may be understood as a static object in the target space. For example, when the target space is in a vehicle, the preset object in the target space may be a seat in the vehicle, and when the target space is a living room in a home, the preset object in the target space may be a sofa, a television, or the like in the living room. The preset object is used as a reference object for acquiring the position of the user.

The terminal device may store a position of a preset object in the target space, where the position of the preset object is a three-dimensional coordinate of the preset object in the target space. The terminal equipment can acquire the conversion relation between the two-dimensional coordinates and the three-dimensional coordinates according to the two-dimensional coordinates of the preset object in the image and the three-dimensional coordinates of the preset object in the target space. The terminal device may obtain the three-dimensional coordinates of the user in the target space, that is, the position of the user in the target space, according to the two-dimensional coordinates of the user in the image and the conversion relationship.

In one example, the terminal device may obtain the location of the user from data collected by the radar sensor. By taking a millimeter wave radar as an example, the millimeter wave radar can emit millimeter waves, the millimeter waves can reflect when encountering obstacles, and the terminal equipment can acquire the position of a user according to the reflected millimeter waves. The terminal equipment can sense the user and the position of the user according to the data acquired by the radar sensor. The target space is exemplified in a vehicle, the terminal device can sense the objects such as a seat and a user in the vehicle according to the data acquired by the radar sensor, and the positions of the objects such as the seat and the user in the vehicle correspond to each other, and the terminal device can sense the positions of the users according to the data acquired by the radar sensor.

In one example, the user's data may further include: the arm length of the user, and the shoulder position. The terminal device can obtain the furthest operation position of the user according to the arm length and the shoulder position of the user.

The terminal equipment can acquire the arm length and the shoulder position of the user according to the data acquired by the sensor. For example, the terminal device may obtain the position of the shoulder of the user, the position of the elbow joint of the user, and the position of the wrist joint of the user (or the position of the palm of the user) according to the video or the image acquired by the camera, and may refer to the description of "the terminal device obtains the position of the user according to the video or the image acquired by the camera". Or the terminal device may acquire the position of the shoulder of the user, the position of the elbow joint of the user, and the position of the wrist joint of the user (or the position of the palm of the user) according to the data acquired by the radar sensor, and may refer to the description of "the terminal device acquires the position of the user according to the data acquired by the radar sensor".

The terminal device may obtain the length of the user's forearm according to the position of the user's shoulder and the position of the user's elbow joint, and obtain the length of the user's forearm according to the position of the user's elbow joint and the position of the user's wrist joint (or the position of the user's palm), where the terminal device may sum the length of the user's forearm and the length of the forearm as the length of the user's arm.

In one example, the terminal device may obtain each arm length for each user.

In one example, to reduce the throughput of the terminal device, the terminal device may obtain the length of the arm of each user that is near the terminal device based on the relative positions of the terminal device and the user. The user of the main driving position in the vehicle is located on the left side of the terminal device, the arm of the user, which is close to the terminal, is the right arm of the user, and the terminal device can acquire the length of the right arm of the user of the main driving position. In one example, taking a video or image captured by a camera as an example, in a case where the video or image cannot completely include the arm of each user in the target space, the terminal device may acquire the length of the arm of the user included in the video or image.

In one example, the location of the terminal device may be stored in the terminal device, and the location of the terminal device may include: three-dimensional coordinates of the boundary of the screen of the terminal device. In one example, the terminal device may obtain the relative positions of the terminal device and the user based on the position of the terminal device and the position of the user.

In one embodiment, the terminal device may obtain the furthest operating position of the user based on the relative position of the terminal device and the user, the shoulder position of the user, the arm length of the user. For example, when the terminal device is located on the right side of the user, the terminal device may add the arm length of the user to the X-axis coordinate of the shoulder position of the user, resulting in the furthest operating position of the user. In one example, the Y-axis and Z-axis coordinates of the furthest operative position may be the same as the Y-axis and Z-axis coordinates of the shoulder position, respectively. For example, when the terminal device is located above the user, the terminal device may add the arm length of the user to the Z-axis coordinate of the shoulder position of the user, resulting in the furthest operating position of the user. In one example, the X-axis and Y-axis coordinates of the furthest operative position may be the same as the X-axis and Y-axis coordinates of the shoulder position, respectively.

In order to adapt to the habit of operating the input method keyboard by the user and improve the user experience, in one embodiment, the terminal device may acquire the furthest operating position of the user according to preset operating data, the relative position of the terminal device and the user, the shoulder position of the user, and the arm length of the user.

Wherein, when the bending angle theta 1 of the big arm and the small arm of the user is in the first preset angle range, the user can comfortably operate the input method keyboard. The first preset angle range θ1 may be (Pi/2-Pi 2/3) radians, for example. Wherein Pi is Pi, the radian and the angle have a mapping relation, and the (Pi/2-Pi 2/3) radian can be converted into 90-120 degrees. In other words, when the input method keyboard is operated, the bending angle θ1 of the user's large and small arms should be in the first preset angle range of "90 ° -120 °". The first preset angle range is included in preset operation data.

When the operation angle theta 2 of the arm of the user is within the second preset angle range, the user can comfortably operate the input method keyboard. The operation angle of the user's arm can be understood as: the angle between the arm of the user and the Y axis. Illustratively, the second predetermined angular range θ2 may be (0-Pi/6) radians, where (0-Pi/6) radians may be converted to 0-30. In other words, when the input method keyboard is operated, the operation angle θ2 of the user's arm should be within the second preset angle range of "0 ° -30 °". The second preset angle range is included in preset operation data.

Wherein, when the farthest distance from the position of the shoulder is less than or equal to the first preset distance, the user can comfortably operate the input method keyboard. For example, the first preset distance d1 may be expressed as the following formula one:

d1 Equation one of =d _Arm ×sin (Pi/3)

Where d _Arm is the arm length of the user. It should be appreciated that the user's arms include a large arm and a small arm, for which the furthest operating distance of the user's large arm may be: d _{Big arm} ×sin (Pi/3), for the forearm, the furthest operating distance of the user's forearm may be: d _{Forearm (forearm)} ×sin (Pi/3).

Assuming the shoulder position of the user is (X _{Shoulder part},Y_{Shoulder part},Z_{Shoulder part}), in one example, when the terminal device is on the right side of the user, the terminal device may acquire the furthest operating position d _{Furthest distance} of the user using equation two:

d _{Furthest distance (X)}＝X_{Shoulder part} +d1×sin θ2 equation two

Wherein θ2 may be any angle of 0 ° -30 ° when the terminal device acquires the operation distance of the user, and θ2 is Pi/6 when the terminal device acquires the farthest operation position d _{Furthest distance} of the user. When the terminal device is on the right side of the user, the user needs to extend the arm to the right to operate the input method keyboard on the terminal device, the terminal device can acquire the furthest operating position d _{Furthest distance (X)} of the user, and the d _{Furthest distance (X)} can be understood as the furthest right boundary.

Similarly, when the terminal device is on the left side of the user, the user needs to unfold the arm leftwards to operate the input method keyboard on the terminal device, the terminal device can acquire the furthest operating position d _{Furthest distance (X)}＝X_{Shoulder part} -d1×sin θ2 of the user, and the d _{Furthest distance} can be understood as the furthest left boundary.

Similarly, when the terminal device is above the user, the user needs to extend the arm upwards to operate the input method keyboard on the terminal device, the terminal device can obtain the furthest operating position d _{Furthest distance (Z)}＝Z_{Shoulder part} +d1×sin θ2 of the user, and the d _{Furthest distance (Z)} can be understood as the furthest upper boundary.

For example, referring to fig. 4, taking the target space as an example in a vehicle, the vehicle includes three users sitting in a main driving position, a co-driving position, and a rear row, respectively. In the embodiment of the present application, the terminal device may acquire data of each user, and the data of each user may refer to the above related description. For example, taking a user sitting in the main driving position as an example, the terminal device (such as a vehicle terminal) is located on the right side of the user, and the data of the user may include: the furthest right boundary of the user. For example, taking a user sitting in the co-driver seat as an example, the terminal device (such as a vehicle terminal) is located on the left side of the user, and the data of the user may include: the furthest left boundary of the user.

In one example, the user's data may further include: inclination angle of the user's line of sight. For example, the terminal device may obtain the position of the eyes of the user according to the video or the picture acquired by the camera or according to the data acquired by the millimeter wave radar. The terminal equipment connects the position of eyes of the user with the position of the central point of the screen of the terminal equipment to obtain a ray, and the included angle between the ray and the screen can be used as the inclination angle of the sight line of the user. It should be understood that the angle of inclination of the user's line of sight can be understood as: the angle of inclination of the line of sight when the user gazes at the screen.

In one example, the user's data may further include: the head position of the user and the area on the screen at which the user gazes. The terminal device can acquire the head position of the user according to the data acquired by the sensor, and can refer to the related description of 'the terminal device acquires the position of the user according to the video or the image acquired by the camera'. The terminal device can connect the central point of the region where the user looks with the position of the eyes of the user to obtain a ray, and the included angle between the ray and the screen can be used as the inclination angle of the sight of the user.

Here, a method for the terminal device to acquire an area on the screen at which the user gazes will be described:

In one example, the terminal device may perform three-dimensional eye model reconstruction, for example, the terminal device may construct a geometric model in a three-dimensional space of a face and eyes of a user through a ranging device such as a laser radar, so as to estimate a region of the user's gaze on a screen according to a specific geometric relationship between eyes and an object when eyes gaze the object.

In one example, the terminal device may employ a deep learning model, input each frame of image containing both eyes of the user as input to the deep learning model, and the deep learning model may output the region on the screen where the user gazes, which is an end-to-end scheme. The training process of the deep learning model is not repeated in the embodiment of the application.

S302, the terminal equipment acquires a data set of an input method keyboard according to the data of each user.

After the terminal obtains the data of each user in the target space, the data of the input method keyboard of each user can be obtained according to the data of each user, so as to obtain a data set of the input method keyboard. The data set of the input method keyboard comprises: the identity of each user, and the data of each user's input method keyboard. Illustratively, the identification of the user is used to distinguish between different users in the target space. The user identification can be represented by the position of the user, or the terminal equipment can number the users at different positions after acquiring the position of the user, and the user identification can also be represented by the number.

In one example, the data of the user's input method keyboard includes, but is not limited to: the position and size of the input method keyboard in the terminal equipment and the size of the keys in the input method keyboard. In one embodiment, the input method keyboard may be located on the screen of the terminal device near the user and within the furthest operating distance of the user.

In one example, the position and the size of the input method keyboard in the terminal device may be represented by two-dimensional coordinates of the input method keyboard in the coordinate system of the screen of the terminal device, and the size of the keys in the input method keyboard may be represented by two-dimensional coordinates of the keyboard in the input method keyboard in the coordinate system of the screen of the terminal device. In one example, if the input method keyboard is rectangular, the position and the size of the input method keyboard in the terminal device can be represented by two-dimensional coordinates of four vertexes of the input method keyboard in a coordinate system of the screen. The embodiment of the application does not limit how the terminal equipment stores the data of the input method keyboard of the user.

It should be understood that the method for acquiring the data of the input method keyboard of each user by the terminal device is the same, and here, taking one user as an example for explaining that the terminal device acquires the data of the input method keyboard of the user:

In one embodiment, the terminal device may obtain the data of the input method keyboard of the user according to the relative positions of the terminal device and the user and the furthest operation position in the data of the user.

The terminal equipment can determine the position of the input method keyboard in the screen of the terminal equipment according to the relative positions of the terminal equipment and the user. Wherein the input method keyboard is near the user's position in the screen. Illustratively, when the terminal device is located on the right side of the user, the user is located on the left side of the terminal device, and the terminal device may determine that the input method keypad is on the left side of the screen. In one example, the left boundary of the input method keyboard may be aligned with the left boundary of the screen, or the left boundary of the input method keyboard may be a preset distance from the left boundary of the screen.

The terminal device may determine the size of the input method keypad according to the relative positions of the terminal device and the user, and the furthest operating position of the user. The terminal device may determine the size of the input method keyboard according to the furthest operation position of the user facing the terminal device and the position of the boundary of the screen facing the user in the terminal device. Illustratively, referring to fig. 5A, when the terminal device is located on the right side of the user, the user is located on the left side of the terminal device, and the terminal device may use the coordinate of the X-axis in the left boundary of the screen of the terminal device, and the difference d _{Wide width of} between the farthest right boundaries of the user, as the width of the input method keyboard. The height of the input method keyboard is not limited in this example, e.g., the height of the input method keyboard may be the first height threshold. Illustratively, referring to fig. 5B, when the terminal device is located above the user, the user is located below the terminal device, and the terminal device may regard the coordinate of the Z-axis in the boundary below the screen of the terminal device, and the difference d _{High height} between the farthest upper boundaries of the user, as the height of the input method keyboard, which in this example is not limiting the width of the input method keyboard, as the width of the input method keyboard may be the first width threshold.

In one example, the size of the keys in the input method keyboard is a preset size, for example, the length and width of the keys are 1cm. In one example, the terminal device may also determine the size of the keys in the input method keyboard based on the furthest operational position of the user towards the terminal device and the position of the boundary of the screen in the terminal device towards the user.

For example, referring to fig. 5A, if the width d _{Wide width of} of the input method keyboard is greater than the first width threshold, the terminal device may increase the width of the keys in the input method keyboard, and if the terminal device may average the difference between the width d _{Wide width of} of the input method keyboard and the first width threshold to each key. If the input method keyboard comprises 10 rows of keys, and the difference between the width d _{Wide width of} of the input method keyboard and the first width threshold is 10cm, the terminal equipment can increase the width of the keys in each row by 1cm. In an example, the terminal device may further average the difference between the width d _{Wide width of} of the input method keyboard and the first width threshold, where the difference is distributed to a key in a half of the input method keyboard away from the user direction, and referring to fig. 5A, the embodiment of the present application is not limited to this, where the difference is distributed to a right half of the input method keyboard.

For example, if the height d _{High height} of the input method keyboard determined by the terminal device is greater than the first height threshold, the terminal device may increase the height of the keys in the input method keyboard, e.g., the terminal device may average the difference between the height d _{High height} of the input method keyboard and the first height threshold among each key. If the input method keyboard comprises 10 rows of keys, and the difference between the height d _{High height} of the input method keyboard and the first height threshold is 10cm, the terminal equipment can increase the height of the keys in each row by 1cm.

In a vehicle, on the one hand, the ease of handling of an input method keyboard derives from the key base size. The distance between the position of the user in the vehicle and the terminal of the vehicle machine is 40-80cm, the key width is more than 1cm, the operation can be more accurate, and the key height is about 1 cm. On the other hand, when the user leans right turn, the key on the right side in the input method keyboard is easy to be mispointed to the left position, and the width of the key on the right side should be increased to solve the problem. In the embodiment of the application, one possible keyboard design is: the keys of the left half part of the keyboard in the input method keyboard are 1cm in width, the keys of the right half part of the keyboard are 2cm in width, and the total width of the input method keyboard is about 16 cm. In one example, the input method keyboard total width of 16cm may be referred to as a first width threshold. It should be understood that the width of each key in the input method keyboard is not limited, and may be increased or decreased in a uniform manner.

In one embodiment, the terminal device may obtain the data of the input method keyboard of the user according to the relative position of the terminal device and the user, the furthest operation position in the data of the user, and the information of the terminal device. The information of the terminal equipment comprises: boundary position of screen of terminal equipment and size of terminal equipment.

The terminal device can determine the position of the input method keyboard in the terminal device according to the relative positions of the terminal device and the user, wherein the input method keyboard is close to the position of the user in the screen. Illustratively, when the terminal device is located on the right side of the user, the user is located on the left side of the terminal device, and the terminal device may determine that the input method keypad is on the left side of the screen.

The terminal device can acquire the size of the input method keyboard according to the relative position of the terminal device and the user, the furthest operation position in the data of the user and the information of the terminal device. In one example, the terminal device may obtain the size of the input method keypad based on the furthest operational position towards the terminal device, the position of the boundary of the terminal device towards the user's screen.

Illustratively, when the terminal device is located on the right side of the user, the user is located on the left side of the terminal device, and the terminal device may acquire the size of the input method keyboard according to the furthest right boundary of the user, the left boundary of the screen of the terminal device, and the size of the terminal device. If the terminal device can obtain the difference between the coordinate of the X axis in the left boundary of the screen of the terminal device and the coordinate of the X axis in the furthest right boundary of the user, the size of the input method keyboard is determined according to the difference. It should be understood that, in the embodiment of the present application, the terminal device is located on the right side of the user, and the furthest right boundary of the user, the left boundary of the screen, etc. are described as examples, and in other scenarios of "the relative positions of the terminal device and the user", reference may be made to the relevant descriptions in this example.

Referring to a in fig. 6, when the difference is greater than or equal to the first difference threshold, which characterizes a position where the user may operate farther, the terminal device may determine that the width of the input method keyboard is the first width threshold, in this example without limiting the height of the input method keyboard, as may be the first height threshold. In such an example, the width of the key located on the left half of the input method keyboard may be a fourth width threshold, such as 1cm, and the height may be a fourth height threshold, such as 1cm. The width of the key located at the right half of the input method keyboard may be a fifth width threshold, for example, 2cm, and the height may be a fourth height threshold, for example, 1cm, where the fourth width threshold and the fourth height threshold may be equal or different, and the fifth width threshold is greater than the fourth width threshold. In an example, the size of the keys in the input method keyboard may also be determined in such a way that the width of the keys in the input method keyboard increases in sequence in a direction away from the user, and in an example, the user is located at the left side of the terminal device, and the width of the keys in the input method keyboard may increase in sequence in a direction from left to right.

Referring to b in fig. 6, when the difference is less than the first difference threshold and greater than or equal to the second difference threshold, which indicates that the farthest position that the user can operate is limited, the terminal device may determine that the width of the input method keyboard is the second width threshold, which in this example is not limiting the height of the input method keyboard, such as may be the first height threshold. Wherein the second width threshold is less than the first width threshold.

Referring to c in fig. 6, when the difference is smaller than the second difference threshold, the farthest position where the user can operate is characterized as being closer, the terminal device determines that the width of the input method keyboard can be the third width threshold, the width of the middle key of the input method keyboard is the fourth width threshold, and the left boundary of the input method keyboard is aligned with the left boundary of the screen. In addition, to facilitate the user's ability to operate each key on the keys, in one example, the terminal device may also adjust the layout of the keys or adaptively reduce the distance between the keys.

Similarly, when the screen is located above the user, the terminal device may acquire a difference between the coordinates of the Z axis in the lower boundary of the screen and the coordinates of the Z axis in the farthest upper boundary of the user, and determine the size of the input method keyboard according to the difference. For example, if the difference is greater than or equal to the first difference threshold, the user may be represented as a remote location, and the terminal device may determine that the height of the input method keyboard is the first height threshold, without limiting the height of the input method keyboard. When the difference is smaller than the first difference threshold and greater than or equal to the second difference threshold, the furthest position, which characterizes that the user can operate, is limited, the terminal device can determine the height of the input method keyboard as the second height threshold, and the height of the input method keyboard is not limited in this example, as can be the first height threshold. Wherein the second height threshold is less than the first height threshold. And when the difference is smaller than the second difference threshold, the farthest position which can be operated by the user is characterized as being closer, and the terminal equipment determines the height of the middle key of the input method keyboard as a third height threshold. The third height threshold is less than the second height threshold.

Here, data of an input method keyboard in a vehicle terminal are exemplified:

First, referring to a in fig. 6, when a difference (e.g., a difference of coordinates of an X axis) between a furthest right boundary of a user sitting in a main driving position and a left boundary of a screen is greater than or equal to 13cm, as in a vehicle, a left starting point of an input method keyboard may be the left boundary of the screen or a preset distance from the left boundary, and a width of the input method keyboard is a first width threshold, e.g., 16cm. In such an example, the terminal device may optimize the size of the keys in the input method keyboard, such as increasing the width of the keys on the right half of the input method keyboard, or sequentially increasing the width of the keys in a left-to-right order. Of these, 13cm is taken as an example of the first difference threshold.

Secondly, referring to b of fig. 6, when the difference between the furthest right boundary of the user sitting in the main driving position and the left boundary of the screen is less than 13cm and greater than 10cm, as in the vehicle, the left starting point of the input method keyboard may be the left boundary of the screen or a preset distance from the left boundary, and the width of the input method keyboard may be a second width threshold, such as 11cm. In this example, to maintain user operation comfort, the terminal device may not perform optimization of the key size in the input method keyboard, e.g., the width and height of the keys are each 1cm. Of these, 10cm is an example of a second difference threshold.

Third, referring to c in fig. 6, when the difference between the furthest right boundary of the user sitting in the main driving position and the left boundary of the screen is less than 10cm, as in the vehicle, the left starting point of the input method keyboard may be the left boundary of the screen, and the width and the height of the keys in the input method keyboard are both ensured to be 1cm. In one example, the terminal device may also adjust the layout of the keys to enable the width of the adjusted input method keyboard to reach 10cm, or the terminal device may adaptively reduce the distance between the keys, so that the user may operate each key on the keys.

In one embodiment, the terminal device may also adaptively adjust the data of the input method keyboard according to the size of the screen of the terminal device. For example, referring to the description of "one of," if the width of the screen of the terminal device is greater than the first width threshold, the terminal device may determine that the input method keyboard width may be the first width threshold. If the width of the screen of the terminal device is smaller than the first width threshold, if the furthest right boundary of the user exceeds the right boundary of the screen, in this case, the terminal device may adjust the width of the input method keyboard to the width of the screen, so that the screen may completely display the input method keyboard. In addition, when the width of the key in the input method keyboard is larger than the fourth width threshold, the terminal equipment can adjust the width of the key to the fourth width threshold so as to reduce the width of the input method keyboard, and the screen can completely display the input method keyboard.

Similarly, referring to the description of "two of them", if the width of the screen of the terminal device is greater than the second width threshold, the terminal device may determine that the width of the input method keyboard may be the second width threshold. If the width of the screen of the terminal device is smaller than the second width threshold, if the furthest right boundary of the user exceeds the right boundary of the screen, in this case, the terminal device may adjust the width of the input method keyboard to the width of the screen, so that the screen may completely display the input method keyboard.

In one embodiment, the terminal device may determine a distance between the terminal device and the user based on the location of the terminal device and the location of the user, and when the distance between the terminal device and the user is greater than a distance threshold, the user may be prevented from operating an input method keyboard displayed on a screen of the terminal device. In this case, when the input method keyboard includes the voice key, the terminal device may increase the size of the voice key, so as to facilitate prompting the user to perform voice interaction with the terminal device. In one example, the terminal device may also highlight the position of the voice key in the input method keyboard in the following manner: highlighting, blinking, etc. In one example, the terminal device may also be carried in the data of the input method keyboard: and voice prompt information. The voice prompt information is used for indicating that the target user is a user with the distance from the terminal equipment being greater than the distance threshold value, for example, the terminal equipment can play voice or display text and the like, and prompts the user to adopt a voice interaction mode.

Illustratively, the vehicle includes three users seated in a main driver's seat, a co-driver's seat, and a rear row, respectively. The terminal device may acquire data of the input method keypad of each user. Referring to a in fig. 4, data of an input method keypad of a user seated in a main driving position includes: the input method keyboard is positioned on the left side of the screen of the vehicle terminal, the left boundary of the input method keyboard is aligned with the left boundary of the screen, the width of the input method keyboard is 16cm, the height of the input method keyboard is a first height threshold value, such as 12cm, the width and the height of keys on the left half side of the input method keyboard are 1cm, and the width and the height of keys on the right half side of the input method keyboard are 2cm.

Referring to b in fig. 4, the data of the input method keyboard of the user seated in the co-driver's seat includes: the input method keyboard is positioned on the right side of the screen of the vehicle terminal, the right boundary of the input method keyboard is aligned with the right boundary of the screen, the width of the input method keyboard is 16cm, the height of the input method keyboard is a first height threshold value, such as 12cm, the width and the height of keys on the right half of the input method keyboard are 1cm, and the width and the height of keys on the left half of the input method keyboard are 2cm.

Referring to c in fig. 4, the user seated in the rear row is far from the terminal of the car machine, and the data of the input method keypad of the user seated in the rear row includes: the input method keyboard is positioned in the middle of the screen of the vehicle terminal, the width of the input method keyboard is 16cm, the height of the input method keyboard is a first height threshold value, for example, 12cm, the width and the height of voice keys of the input method keyboard are 3cm, and the width and the height of other keys are 1cm.

Referring to the above description, by way of example, in a smart home scenario, when a child operates the center control screen, the center control screen is located above the child, the lower boundary of the input method keyboard of the center control screen may be aligned with the lower boundary of the center control screen, and the terminal device may determine the data of the input method keyboard according to the furthest operation position of the child (such as the uppermost boundary position) and the lower boundary position of the screen of the terminal device, which may be described with reference to the related description in the above embodiments.

In this example, user a is an adult user, as user B is a relatively tall child. Referring to a in fig. 7, the central control screen is located above the child, and the data of the input method keyboard of the child includes: the input method keyboard is positioned on one side of the screen of the vehicle terminal, which is close to a child, for example, the lower boundary of the input method keyboard is aligned with the lower boundary of the screen of the central control screen, the width of the input method keyboard is 16cm, the height of the input method keyboard is smaller than a first height threshold value, for example, 10cm, so that the child can smoothly operate the input method keyboard, the width and the height of keys on the upper half side of the input method keyboard are 2cm, and the width and the height of keys on the lower half side of the input method keyboard are 1cm.

Referring to b in fig. 7, data of the input method keyboard of the adult user includes: the input method keyboard is positioned in the middle of the screen of the vehicle terminal, the width of the input method keyboard is 16cm, the height of the input method keyboard is smaller than a first height threshold value, such as 12cm, and the width and the height of keys of the input method keyboard are 1cm.

In one example, the data of the user's input method keyboard may further include: display properties of keys and background in the input method keyboard. The input method keyboard is characterized in that keys are arranged on the input method keyboard, and the rest areas are the background of the input method keyboard. Wherein, in one example, when the data of the user comprises: when the inclination angle of the user's sight line is larger than a preset angle, the terminal device can detect whether the inclination angle of the user's sight line is larger than the preset angle. When the inclination angle of the user's sight line is larger than a preset angle, the user cannot accurately distinguish the keys and the background in the input method keyboard, and cannot accurately operate the input method keyboard.

In such an example, the terminal device may adjust display properties of keys and a background in the input method keyboard, the display properties including at least one of: color, gray scale, brightness, dynamic effects, etc. Taking a in fig. 4 as an example, if the inclination angle of the line of sight of the user sitting in the main driving position is greater than a preset angle, for example, the terminal device may use two colors with high contrast for the color of the key and the color of the background, so as to improve the visibility of the key in the input method keyboard. Referring to fig. 8, the color of the key is white, and the color of the background is black.

In one possible scenario, too high ambient light in the target space may also affect the display effect of the input method keyboard, and, illustratively, when the ambient light is too high, the user may not see the keys in the input method keyboard clearly, and may not operate the input method keyboard accurately. In this example, the terminal device may obtain a data set of the input method keyboard according to the data of the user and the ambient light level of the target space. The terminal device obtains the data set of the input method keyboard according to the data of the user, and the related description can be referred to.

In this example, the terminal device may adjust display attributes of keys and backgrounds in the input method keyboard adaptively according to the ambient light level of the target space, so that the user may accurately distinguish between the keys and the backgrounds in the input method keyboard, so that the user may accurately operate the input method keyboard. The terminal device can acquire the ambient light brightness of the target space acquired by the ambient light sensor, and when the ambient light brightness of the target space is greater than or equal to the preset brightness, the terminal device can adjust the display attributes of keys and the background in the input method keyboard, and the display attributes can be described with reference to the related description.

For example, taking a in fig. 4 as an example, if the brightness of the environment light in the vehicle is greater than or equal to the preset brightness, for example, the terminal device may use two colors with high contrast for the color of the key and the color of the background, so as to improve the visibility of the key in the input method keyboard. Referring to fig. 8, the color of the key is white, and the color of the background is black.

In the embodiment of the application, the terminal equipment can generate the data which is suitable for the input method keyboard of the user according to the data of the user, can also adjust the display attribute of the keys and the background of the input method keyboard by combining the ambient light brightness which influences the display effect of the input method keyboard, and is convenient for the user to accurately distinguish the keys and the background in the input method keyboard so as to ensure that the user can accurately operate the input method keyboard.

S303, the terminal equipment acquires the data of the input method keyboard of the target user in the data set of the input method keyboard.

In one example, in response to an operation of a target user in the target space, the terminal device may acquire data of the input method keyboard of the target user in the data set of the input method keyboard, the operation of the target user being an operation using the input method keyboard. The operation of the target user using the input keyboard can be understood as: triggering the terminal equipment to display the input method keyboard or operating the displayed input method keyboard. The target user is a user using an input method keyboard.

In the embodiment of the application, the terminal equipment can determine the target user in the target space.

In one example, the voice of each user in the target space may be pre-recorded in the terminal device, so as to obtain the voiceprint of each user, and if the target user triggers the input method keyboard in a voice manner, the terminal device may determine the target user in a voiceprint comparison manner.

In one example, the target user needs to move the arm to operate the screen, and the terminal device can take the user moving the arm as the target user according to the video or the image acquired by the camera when detecting the operation event on the screen. It should be noted that the operational event is used to trigger the display of an input method keyboard or the operational event characterizes the user operating the input method keyboard.

The terminal device responds to the operation of the target user in the target space, and the terminal device can acquire the data of the input method keyboard of the target user in the data set of the input method keyboard. The terminal equipment can acquire the data of the input method keyboard corresponding to the identification of the target user, namely the data of the input method keyboard of the target user, in the data set of the input method keyboard according to the identification of the target user. For example, if in the vehicle, the target user is a user sitting in the main driving position, the data of the input method keyboard of the target user may be: and the data set of the input method keyboard is the data of the input method keyboard of the user sitting in the main driving position.

In one example, the terminal device may also determine, in conjunction with an area on the screen at which the user gazes, whether the user desires to operate the input method keyboard, where when the user desires to operate the input method keyboard, the terminal device may determine that the user desiring to operate the input method keyboard is a target user. For example, if the area at which the user gazes on the screen is the area where the preset element exists on the screen, the terminal device determines that the user needs to operate the input method keyboard. Illustratively, preset elements such as input boxes, voice assistants, and the like. And if the region watched by the user on the screen is an input box, representing that the user needs to input contents such as text by adopting the input box, taking the user as a target user.

The example can be applied to a scene that the distance between the terminal equipment and the user is greater than a distance threshold, wherein if the terminal equipment determines that the area where the user gazes on the screen is the area where the preset element exists on the screen under the condition that the distance between the terminal equipment and the user is greater than the distance threshold, the terminal equipment can determine that the user needs to operate the input method keyboard, and the user can be taken as a target user. For example, the target user may be a user sitting in the rear row of the vehicle. In this example, the target user is a user whose region gazed on the screen is a region where the preset element exists.

S304, the terminal equipment displays the input method keyboard according to the data of the input method keyboard of the target user.

For example, referring to a in fig. 4, if the target user is a user sitting in the main driving position, the terminal device may display the input method keypad according to data of the input method keypad of the user sitting in the main driving position. Referring to b in fig. 4, if the target user is a user sitting in the co-driver's seat, the terminal device may display the input method keypad according to data of the input method keypad of the user sitting in the co-driver's seat. Referring to c in fig. 4, if the target user is a user sitting in the rear row, the terminal device may display the input method keypad according to data of the input method keypad of the user sitting in the rear row. It should be understood that, in the embodiment of the present application, if the target user changes from the user in the main driving position to the user in the co-driving position, the on-screen input method keyboard may be switched from a in fig. 4 to b in fig. 4.

For example, referring to a in fig. 7, in a smart home scenario, if the target user is a child, the terminal device may display the input method keyboard according to data of the input method keyboard of the child. Referring to b in fig. 7, if the target user is an adult user, the terminal device may display the input method keypad according to data of the input method keypad of the adult user.

That is, in the embodiment of the present application, the input method keyboard is located on the screen of the terminal device at a position close to the target user and within the farthest operation distance of the target user.

In one example, the terminal device may also increase the size of the voice keys in the child's input method keypad to facilitate prompting the child for voice interaction when the uppermost boundary position of the child is below 1/2 of the height of the screen of the terminal device. In one example, when the uppermost boundary position of the child is lower than 1/2 of the height of the screen of the terminal device, the terminal device may further carry in the data of the input method keyboard of the child: and voice prompt information. The voice prompt information is used for prompting a user to adopt a voice interaction mode when the uppermost boundary position is lower than the height of 1/2 of the screen of the terminal equipment in a voice prompt mode or a text prompt mode. It should be understood that 1/2 is an exemplary number and embodiments of the present application are not limited in this regard.

In the embodiment of the application, the terminal equipment can acquire the data of the user in the target space in advance by combining the data acquired by the sensor, acquire the data of the input method keyboard adapted to the user according to the data of the user, and directly call the data of the input method keyboard of the target user to display the input method keyboard adapted to the target user when the target user executes the operation of triggering the input method keyboard. The embodiment of the application can display the input method keyboard which is adapted to the user, can solve the problem that the user cannot operate the input method keyboard, can enable the user to accurately operate the input method keyboard, and on the other hand, when the terminal equipment does not detect the operation of the target user, the terminal equipment acquires the data of the input method keyboard according to the data of the user so as to generate the input method keyboard, but generates the data which is adapted to the input method keyboard of the user in advance, and when the target user executes the operation for triggering the input method keyboard, the data of the input method keyboard of the target user is directly called, so that the display speed of the input method keyboard can be improved, and the user experience can be improved.

In order to ensure the accuracy of the data set of the input method keyboard and the accuracy of the display of the input method keyboard, in one embodiment, the terminal device may detect the data of the user in the target space, and when the data of the user in the target space is changed, the terminal device may update the data set of the input method keyboard according to the new data of the user.

For example, if the number of users changes, such as the number of users increases or decreases, i.e. the data of the users changes, in the target space, for example, the terminal device may add data of an input method keyboard of a new user to the data set of the input method keyboard, or delete data of an input method keyboard of a reduced user to update the data set of the input method keyboard. Or if the position of the user changes, namely the data of the user changes, for example, the terminal equipment can update the data of the user in the vehicle according to the data acquired by the sensor, and the terminal equipment can acquire the data of a new input method keyboard of the user according to the updated data of the user so as to update the data set of the input method keyboard.

Referring to fig. 9, in one embodiment, before S303 or after S304, the terminal device may perform S305:

S305, updating the data set of the input method keyboard according to the data of the new user in response to the change of the data of the user in the target space.

It should be understood that the terminal device may acquire the data of the user in the target space according to the data acquired by the sensor, and reference the related description in S301. The terminal device responds to the change of the data of the user in the target space, and can acquire the data of the new input method keyboard according to the data of the new user, and the related description in S302 can be referred to.

It should be understood that the terminal performs S305 before S303 is illustrated in fig. 9 as an example. In this embodiment, S303 may be replaced with S303A: and acquiring the data of the input method keyboard of the target user in the updated data set of the input method keyboard.

It should be understood that if the terminal device performs S305 after S304, the terminal device may perform S303A, S304 after S305.

In the embodiment of the application, the terminal equipment can detect the data of the user in the target space, and when the data of the user in the target space is changed, the terminal equipment can update the data set of the input method keyboard according to the data of the new user so as to ensure the accuracy of the data set of the input method keyboard.

Fig. 10 is a schematic structural diagram of a terminal device according to an embodiment of the present application. Referring to fig. 10, the terminal device may include: the system comprises a sensor data processing module, a user data storage module, an input method keyboard generation module, an input method keyboard data storage module, a voice module and a display module.

The sensor data processing module is configured to receive data collected by the sensor, acquire data of the user, and detect whether the data of the user changes, and may refer to the related descriptions in S301 and S305.

And the user data storage module is used for storing the data of the user.

The input method keyboard generation module is configured to generate data of the input method keyboard of the user according to the data of the user stored in the user data storage module, and reference may be made to the related description in S302.

The input method keyboard data storage module is used for maintaining a data set of the input method keyboard, wherein the data set of the input method keyboard comprises the identification of a user and the data of the input method keyboard of the user.

And the voice module is used for prompting the user to adopt a voice interaction mode in response to the fact that the sensor data processing module detects that the distance between the user and the terminal equipment is greater than a distance threshold value or the user cannot operate an input method keyboard on a screen of the terminal equipment.

The display module, for displaying an interface of the terminal device, such as displaying an input keypad of the target user, may refer to the related description in S303 and S303.

It should be noted that, the data (including, but not limited to, data for analysis, stored data, displayed data, etc.) of the user related to the present application are all information and data authorized by the user or fully authorized by each party, and the collection, use and processing of the related data need to comply with the related laws and regulations and standards of the related country and region, and provide corresponding operation entries for the user to select authorization or rejection.

In an embodiment, the embodiment of the present application further provides an electronic device, which may be the terminal device described in the foregoing embodiment. Referring to fig. 11, the electronic device may include: a processor 1101 (e.g., a CPU), a memory 1102. The memory 1102 may include a random-access memory (RAM) and may also include a non-volatile memory (NVM), such as at least one disk memory, in which various instructions may be stored in the memory 1102 for performing various processing functions and implementing method steps of the present application.

Optionally, the electronic device according to the present application may further include: a power supply 1103, a communication bus 1104, and a communication port 1105. The communication port 1105 is used to implement connection communication between the electronic device and other peripheral devices. In an embodiment of the present application, memory 1102 is used to store computer-executable program code, which includes instructions; when the processor 1101 executes the instructions, the instructions cause the processor 1101 of the electronic device to perform the actions in the above-described method embodiments, and the implementation principle and technical effects are similar, which are not described herein again.

In one example, the electronic device may also include a display 1106, the display 1106 for displaying an input method keyboard. In one example, the display 1106 may be understood as a screen in the above embodiment. Wherein the display 1106 comprises a display panel. The display panel may employ a Liquid Crystal Display (LCD) CRYSTAL DISPLAY, an organic light-emitting diode (OLED), an active-matrix organic LIGHT EMITTING diode (AMOLED), a flexible light-emitting diode (FLED), miniled, microLed, micro-oLed, a quantum dot LIGHT EMITTING diode (QLED), or the like. In some embodiments, the terminal device may include 1 or N displays 1106, N being a positive integer greater than 1.

It should be noted that the modules or components described in the above embodiments may be one or more integrated circuits configured to implement the above methods, for example: one or more Application SPECIFIC INTEGRATED Circuits (ASICs), or one or more microprocessors (DIGITAL SIGNAL processors, DSPs), or one or more field programmable gate arrays (field programmable GATE ARRAY, FPGAs), etc. For another example, when a module above is implemented in the form of processing element scheduler code, the processing element may be a general purpose processor, such as a central processing unit (central processing unit, CPU) or other processor that may invoke the program code, such as a controller. For another example, the modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions in accordance with embodiments of the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, by wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)), or wireless (e.g., infrared, wireless, microwave, etc.) means from one website, computer, server, or data center. Computer readable storage media can be any available media that can be accessed by a computer or data storage devices, such as servers, data centers, etc., that contain an integration of one or more available media. Usable media may be magnetic media (e.g., floppy disks, hard disks, magnetic tape), optical media (e.g., DVD), or semiconductor media (e.g., solid state disk Solid STATE DISK (SSD)), among others.

The term "plurality" herein refers to two or more. The term "and/or" is herein merely an association relationship describing an associated object, meaning that there may be three relationships, e.g., a and/or B, may represent: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship; in the formula, the character "/" indicates that the front and rear associated objects are a "division" relationship. In addition, it should be understood that in the description of the present application, the words "first," "second," and the like are used merely for distinguishing between the descriptions and not for indicating or implying any relative importance or order.

It will be appreciated that the various numerical numbers referred to in the embodiments of the present application are merely for ease of description and are not intended to limit the scope of the embodiments of the present application.

It should be understood that, in the embodiment of the present application, the sequence number of each process does not mean that the execution sequence of each process should be determined by the function and the internal logic, and should not limit the implementation process of the embodiment of the present application.

Claims

1. A display method of an input method keyboard, which is applied to a terminal device, the method comprising:

acquiring data of each user in a target space, wherein the data of each user comprises: a location of each user, and a furthest operational location of each user;

acquiring a data set of an input method keyboard according to the data of each user, wherein the data set of the input method keyboard comprises the data of the input method keyboard of each user;

Acquiring data of an input method keyboard of a target user in a data set of the input method keyboard, wherein the target user is contained in a user in the target space;

And displaying the input method keyboard on a screen of the terminal equipment according to the data of the input method keyboard of the target user, wherein the input method keyboard is positioned at a position on the screen close to the target user and is positioned in the farthest operation position of the target user.

2. The method of claim 1, wherein the data for each user further comprises: the arm length of each user, and the shoulder position, obtain the furthest operating position of the user in the target space, including:

And acquiring the furthest operation position of the user according to the relative position of the terminal equipment and the user, the arm length of the user and the shoulder position of the user.

3. The method of claim 2, wherein the obtaining the furthest operating position of the user based on the relative position of the terminal device and the user, the arm length of the user, and the shoulder position of the user comprises:

According to the arm length of the user and a first preset angle range, a first preset distance farthest from the shoulder of the user is obtained, and the first preset angle range is as follows: the range of the included angle between the big arm and the small arm of the user;

acquiring the farthest operation position of the user according to the first preset distance, a second preset angle range, the shoulder position of the user and the relative position of the terminal equipment and the user, wherein the second preset angle range is as follows: a range of operating angles of the user's arm.

4. A method according to any one of claims 1-3, wherein said obtaining a data set of an input method keyboard from said data of each user comprises:

According to the data of each user, acquiring the data of the input method keyboard of each user, wherein the data of the input method keyboard of each user comprises: the position of the input method keyboard of each user in the screen, the size of the input method keyboard and the size of keys in the input method keyboard.

5. The method of claim 4, wherein obtaining data of the user's input method keyboard based on the user's data comprises:

acquiring the position of an input method keyboard of the user in the screen according to the relative position of the terminal equipment and the user;

And acquiring the size of the input method keyboard of the user according to the position of the screen and the furthest operation position of the user.

6. The method of claim 4 or 5, wherein the size of the keys in the input method keyboard is a predetermined size.

7. The method of claim 5, wherein the obtaining the size of the user's input method keyboard according to the position of the screen and the furthest operation position of the user comprises:

Acquiring the position of the boundary of the screen facing the user and the difference value of the farthest operation position of the user facing the terminal equipment;

And acquiring the size of the input method keyboard of the user according to the difference value.

8. The method of claim 7, wherein when the difference is greater than or equal to a first difference threshold, the width of the user's input method keyboard is a first width threshold or the height of the user's input method keyboard is a first height threshold;

when the difference value is smaller than the first difference value threshold and larger than or equal to a second difference value threshold, the width of the input method keyboard of the user is a second width threshold, or the height of the input method keyboard of the user is a second height threshold, the second difference value threshold is smaller than the first difference value threshold, the second width threshold is smaller than the first width threshold, and the second height threshold is smaller than the first height threshold;

When the difference value is smaller than the second difference value threshold, the width of the input method keyboard of the user is a third width threshold, or the height of the input method keyboard of the user is a third height threshold, the third width threshold is smaller than the second width threshold, and the third height threshold is smaller than the second height threshold.

9. The method of claim 8, wherein the method further comprises:

and when the difference value is greater than or equal to the second difference value threshold value, increasing the width or the height of all keys or part of keys in the input method keyboard of the user according to the difference value.

10. The method of claim 4, wherein the data for each user further comprises: the inclination angle of each user's sight, the data of each user's input method keyboard still includes: display attributes of keys and backgrounds in an input method keyboard, wherein the display attributes comprise at least one of the following: color, gray scale, brightness, dynamic effect;

According to the data of the user, acquiring the data of an input method keyboard of the user, wherein the data comprises the following steps:

and adjusting display attributes of keys and the background in the input method keyboard of the user in response to the inclination angle of the sight line of the user being larger than a preset angle.

11. The method according to claim 1, wherein the target user is a user using an input method keyboard, and the acquiring data of the input method keyboard of the target user in the data set of the input method keyboard includes:

And responding to the operation of the target user, acquiring the data of the input method keyboard of the target user in the data set of the input method keyboard, wherein the operation of the target user is the operation of using the input method keyboard.

12. The method according to claim 1, wherein the area where the target user gazes on the screen is an area where a preset element exists, and the acquiring data of the input method keyboard of the target user in the data set of the input method keyboard includes:

And under the condition that the distance between the target user and the terminal equipment is larger than the preset distance, responding to the fact that the area where the target user looks at on the screen is the area where the preset elements exist, and acquiring data of the input method keyboard of the target user in the data set of the input method keyboard.

13. The method of any one of claims 1-12, wherein the data of the input method keyboard of each user further comprises: display attributes of keys and backgrounds in an input method keyboard, wherein the display attributes comprise at least one of the following: color, gray scale, brightness, dynamic effect;

The method further comprises the steps of:

acquiring the ambient light brightness of the target space;

and adjusting display attributes of keys and the background in the input method keyboard of the user in response to the ambient light brightness of the target space being greater than preset brightness.

14. An electronic device, comprising: a processor and a memory;

The memory stores computer instructions;

The processor executing computer instructions stored in the memory, causing the processor to perform the method of any one of claims 1-13.

15. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program or instructions, which when executed, implement the method of any of claims 1-13.