WO2017097141A1 - 输入操作的处理方法、装置和智能终端 - Google Patents

输入操作的处理方法、装置和智能终端 Download PDF

Info

Publication number
WO2017097141A1
WO2017097141A1 PCT/CN2016/107596 CN2016107596W WO2017097141A1 WO 2017097141 A1 WO2017097141 A1 WO 2017097141A1 CN 2016107596 W CN2016107596 W CN 2016107596W WO 2017097141 A1 WO2017097141 A1 WO 2017097141A1
Authority
WO
WIPO (PCT)
Prior art keywords
input
response image
voice
curve
reference points
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/107596
Other languages
English (en)
French (fr)
Inventor
林涛
孟龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Publication of WO2017097141A1 publication Critical patent/WO2017097141A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00Two-dimensional [2D] image generation
    • G06T11/20Drawing from basic elements
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00Two-dimensional [2D] image generation
    • G06T11/40Filling planar surfaces by adding surface attributes, e.g. adding colours or textures

Definitions

  • the present application relates to the field of terminal technologies, and in particular, to a processing method of an input operation, a processing device for input operations, and an intelligent terminal.
  • the display interface is usually used to display the content to the user, and the user can also find, view, and operate the content in the display interface.
  • the technical problem to be solved by the embodiments of the present application is to provide a processing method of an input operation to solve the problem that the input situation cannot be known.
  • the embodiment of the present application further provides a processing device and a mobile terminal for input operations, which are used to ensure implementation and application of the foregoing method.
  • the present application discloses a processing method of an input operation, comprising: receiving a user input or acquiring a prompt message in a display interface; drawing a response image according to the user input or prompt message; adding the response image to Display is performed in the display interface.
  • the user input includes: voice input, touch input, and keyboard input.
  • the response image is a dynamically changing image; the change frequency of the response image is related to the user input corresponding input information, and/or the change amplitude of the response image is corresponding to the user input input information.
  • the input information includes volume, input speed, number of inputs, and/or duration.
  • the change frequency is proportional to the change data of the input information; the change amplitude is different from the input
  • the change data of the incoming information is directly proportional.
  • the response image is composed of one or more closed curves.
  • the radius of the closed curve is related to the user input corresponding input information, wherein the input information includes a volume, an input speed, an input quantity, and/or a duration.
  • the moving speed of the closed curve is related to the user input corresponding input information, wherein the input information includes a volume, an input speed, an input quantity, and/or a duration.
  • the method further includes: displaying a response image in the corresponding display interface of the voice assist control when the voice assist control is started, wherein the response image includes a closed curve that is dynamically adjusted according to a preset manner.
  • the user input includes a voice input
  • receiving the user input in the display interface includes: receiving the voice data as a voice input by receiving the voice data in a trigger corresponding to the voice assist control corresponding to the display interface.
  • the response image is drawn according to the user input or receiving the prompt message, including: determining a center and a radius according to the prompt message or the voice input corresponding voice data; and drawing a circular curve according to the center and the radius, using the circle The shape curve generates a response image.
  • the response image is drawn according to the voice input or the receiving prompt message, including: acquiring a preset center of the circle and at least one set of reference points on the circumference corresponding to the radius; and adjusting each group according to the prompt message or the voice input corresponding voice data. a reference point; drawing a closed curve based on at least one set of reference points, and generating a response image using the closed curve.
  • adjusting each group of reference points according to the prompt message or the voice input corresponding voice data including: determining, for each group of reference points, adjusting parameters according to the prompt message or the voice input corresponding voice data, using a sinusoid and a The adjustment parameter adjusts coordinate information of the reference point.
  • determining the adjustment parameter according to the prompt message or the voice input corresponding voice data, and adjusting the reference point by using the sinusoid and the adjustment parameter including: determining an angular velocity adjustment parameter according to the prompt message or the voice data. Or distance adjustment parameter; adjusting the sinusoid according to an angular velocity adjustment parameter and/or a distance adjustment parameter; determining coordinate information of the reference point according to the adjusted sinusoid.
  • drawing a closed curve according to the at least one set of reference points, and generating a response image by using the closed curve comprising: drawing a closed Saybol curve according to coordinate information of at least four reference points of the set of reference points; using the closing The Saybolt curve constitutes a response image.
  • the closed curve is drawn according to the at least one set of reference points, and the closed curve is used to generate the response image, including: drawing closed Cebel curves by using coordinate information of at least two sets of reference points, wherein each set of reference points includes four Reference points; a response image is constructed using at least two closed Sebel curves.
  • the method further includes: when playing the voice assist control corresponding to the auxiliary voice data, drawing a response image according to the auxiliary voice data, and displaying the response image.
  • the method further includes: adding at least one color or at least one pattern to the response image.
  • the method further includes: filling the response image according to any one of the following filling manners; the filling manner includes: filling from shallow to deep, filling from deep to shallow, filling with cold and warm colors.
  • the method further includes: setting a transparency of the response image.
  • the embodiment of the present application further discloses an input operation processing device, including: an input receiving module, configured to receive a user input or obtain a prompt message in a display interface; and a drawing module, configured to draw a response according to the user input or the prompt message And a display module, configured to add the response image to the display interface for display.
  • the user input includes: voice input, touch input, and keyboard input.
  • the response image is a dynamically changing image; the change frequency of the response image is related to the user input corresponding input information, and/or the change amplitude of the response image is corresponding to the user input input information.
  • the input information includes volume, input speed, number of inputs, and/or duration.
  • the change frequency is proportional to the change data of the input information
  • the change amplitude is proportional to the change data of the input information
  • the response image is composed of one or more closed curves.
  • the closed curve is adjusted with user input.
  • the radius of the closed curve is related to the user input corresponding input information, wherein the input information includes a volume, an input speed, an input quantity, and/or a duration.
  • the moving speed of the closed curve is related to the user input corresponding input information, wherein the input information includes a volume, an input speed, an input quantity, and/or a duration.
  • the display module is further configured to: when the voice assist control is started, display a response image in the corresponding display interface of the voice assist control, wherein the response image includes a closed curve that is dynamically adjusted according to a preset manner.
  • the user input includes a voice input
  • the input receiving module is configured to receive the voice data as a voice input by receiving voice data in a trigger corresponding to the voice assist control corresponding to the display interface.
  • the drawing module includes: a first drawing sub-module, configured to determine a center and a radius according to the prompt message or the voice input corresponding voice data; and draw a circular curve according to the center and the radius, and adopt the circle The shape curve generates a response image.
  • the drawing module includes: a second drawing sub-module, configured to acquire a preset center of the circle and at least one set of reference points on a circumference corresponding to the radius; and adjust each group according to the prompt message or the voice input corresponding voice data Benchmark point A closed curve is drawn from at least one set of reference points, and a response image is generated using the closed curve.
  • the second drawing sub-module includes: a parameter adjusting unit, configured to determine, according to the prompt message or the voice input corresponding voice data, an adjustment parameter for each set of reference points, and adopt a sinusoid curve and the adjustment parameter adjustment manner The coordinate information of the reference point.
  • a parameter adjusting unit configured to determine, according to the prompt message or the voice input corresponding voice data, an adjustment parameter for each set of reference points, and adopt a sinusoid curve and the adjustment parameter adjustment manner The coordinate information of the reference point.
  • the parameter adjustment unit is configured to determine an angular velocity adjustment parameter and/or a distance adjustment parameter according to the prompt message or voice data; and adjust the sinusoid according to an angular velocity adjustment parameter and/or a distance adjustment parameter; The coordinate information of the reference point is determined according to the adjusted sinusoid.
  • the second drawing sub-module includes: a drawing generating unit, configured to draw a closed Saybol curve according to coordinate information of at least four reference points of the set of reference points; and adopting the closed Saybel curve to form a response image .
  • the second drawing sub-module comprises: a drawing generating unit, configured to respectively draw closed Saibel curves by using coordinate information of at least two sets of reference points, wherein each set of reference points includes four reference points; using at least two The closed Sabel curve constitutes a response image.
  • the drawing module is further configured to: when playing the voice auxiliary control corresponding to the auxiliary voice data, draw the response image according to the auxiliary voice data.
  • the drawing module further includes: a color filling submodule, configured to add at least one color or at least one pattern to the response image.
  • a color filling submodule configured to add at least one color or at least one pattern to the response image.
  • the drawing module further includes: a color filling sub-module, configured to fill the response image according to any one of the following filling manners; the filling manner includes: filling from shallow to deep, filling from deep to shallow, cold Warm color fill.
  • the drawing module further includes: a transparency setting sub-module, configured to set a transparency of the response image.
  • the embodiment of the present application further discloses an intelligent terminal, including: the smart terminal includes: a memory, a display, a processor, and an input unit, where the input unit includes: a touch screen; Said method.
  • the embodiments of the present application include the following advantages:
  • the user input or the acquisition prompt message is received in the display interface, the response image is drawn according to the user input or the prompt message, and the response image is added to the display interface for display, which can directly be based on the prompt
  • the message or user input draws the response image, prompting the user without the user's other operations and without interfering with the scrolling interaction inherent to the interface.
  • FIG. 1 is a flow chart showing the steps of an embodiment of a processing method of an input operation of the present application
  • FIG. 2 is a flow chart showing the steps of an embodiment of a method for processing voice input according to the present application
  • FIG. 3 is a flow chart showing steps of drawing an adjustment curve in an embodiment of a method for processing a voice input according to the present application
  • FIG. 4 is a schematic diagram of determining a reference point in an embodiment of the present application.
  • FIG. 5 is a schematic diagram showing a closed curve drawn by adjusting a reference point in the embodiment of the present application.
  • FIG. 6 is a schematic diagram of dynamically adjusting a reference point drawing dynamic closed curve in the embodiment of the present application.
  • FIG. 7 is a schematic diagram of drawing a multi-layer dynamic closed curve by adjusting a reference point in the embodiment of the present application.
  • FIG. 8 is a flow chart showing the steps of an embodiment of a method for processing a prompt message according to the present application.
  • FIG. 9 is a flow chart showing the steps of drawing an adjustment curve in an embodiment of a method for processing a prompt message according to the present application.
  • FIG. 10 is a structural block diagram of an embodiment of a processing apparatus for input operations according to the present application.
  • 11A is a structural block diagram of an embodiment of a processing apparatus for another input operation of the present application.
  • FIG. 11B is a structural block diagram of a second drawing sub-module in another embodiment of a processing device for input operation according to the present application.
  • FIG. 12 is a structural block diagram of an embodiment of a smart terminal according to the present application.
  • One of the core concepts of the embodiments of the present application is to provide a processing method, an apparatus, and an intelligent terminal for input operations, so as to solve the problem that the input situation cannot be known.
  • Receiving a user input or obtaining a prompt message in the display interface drawing a response image according to the user input or the prompt message, adding the response image to the display interface for display, and directly drawing a response image based on the user input or the prompt message
  • the user is prompted without the user's other operations and without disturbing the scroll interaction inherent in the interface.
  • the smart terminal refers to a terminal device with multimedia functions, and the devices support functions in audio, video, data, and the like.
  • the smart terminal has a touch screen, and includes a smart mobile terminal, such as a smart phone, a tablet computer, a wearable device, or a smart TV with a touch screen, a personal computer, and the like.
  • FIG. 1 a flow chart of steps of a method for processing an input operation of the present application is shown. Specifically, the method may include the following steps:
  • Step 102 Receive a user input or obtain a prompt message in the display interface.
  • the user can interact with the smart terminal through the input, so that the smart terminal performs a corresponding response operation, so the user can perform a touch operation directly by using a finger, a touch pen, or the like, or input by triggering a physical control such as a button or a button.
  • the smart terminal receives user input correspondingly in the current display interface.
  • the smart terminal may also have a prompt message that needs to remind the user, and the display interface may obtain a prompt message, such as a user subscription, a prompt message for querying the content update, and the like.
  • the user input includes: voice input, touch input, and keyboard input
  • the prompt message includes a voice message
  • the voice input includes the input of the voice data input by the smart terminal, for example, the voice data received after clicking the button in the current interface, and the voice input received in some applications and controls, such as a recording application, such as a voice assist control.
  • the touch input includes touching a corresponding input in a touch screen of the smart terminal, such as a finger click, a slide, and the like.
  • the keyboard input includes input received by the corresponding terminal of the smart terminal, and the keyboard includes various keyboards such as a physical keyboard and a virtual keyboard, for example, an operation of inputting characters by clicking a keyboard.
  • Step 104 Draw a response image or receive a prompt message according to the user input.
  • Step 106 Add the response image to the display interface for display.
  • the corresponding operation can be performed according to the user input.
  • the prompt message can prompt the user to know the content, so after receiving the prompt message, the response image can also be drawn based on the prompt message.
  • the response image may include being drawn and displayed in response to the user input or the prompt message for prompting the user of the current input state or the content currently presenting the reminder, etc., so after the response image is drawn, the response image may be added to the display Display in the interface to prompt the user. Therefore, a response image can be displayed in the current interface, giving a user dynamic interactive experience.
  • the prompt message often prompts once by the prompt tone, or the flash time in the interface is relatively short, which is easily ignored by the user, and the prompt may not be timely.
  • the display interface can display a response image for display, and the user prompts for a long time to prevent the user from being ignored.
  • the user input may be continuous or instantaneous, and various response images may be displayed according to different user inputs, for example, a continuous voice input may display a dynamic response image, and for a click input. The response image is drawn with each click.
  • the response image is a dynamically changing image; and one or more curves drawn according to an image drawing method such as a Bezier curve may be a curve having a specific feature, such as a sine and a cosine curve. It can also be a curve that is randomly transformed.
  • the change frequency of the response image is related to the user input corresponding input information, and/or the change amplitude of the response image is related to the user input corresponding input information; since the response image is changed, the response image is usually
  • the frequency of change and the magnitude of the change may be related to a user input, such that the frequency of change and the magnitude of the change may be non-linear changes, wherein the input information includes volume, input speed, number of inputs, and/or duration.
  • the frequency or amplitude is varied depending on the volume, input speed, number of inputs, and/or duration.
  • the change frequency is proportional to the change data of the input information
  • the change amplitude is proportional to the change data of the input information.
  • the input information is usually not static. For example, the volume and duration of the voice input will change with the input. The touch input, the input speed of the keyboard input, and the input quantity will change with the input. Therefore, the change of the input information generates change data, and the change data. Determined by the preset method, such as the change data is the volume becomes louder, the input becomes slower, the duration increases, and the like.
  • the corresponding change frequency and change amplitude can be proportional to the change data. If the volume becomes larger, the change frequency and the change range increase. When the input becomes slower, the change frequency and the change range slow down.
  • the response image corresponding to the prompt message may be changed according to a preset change frequency, a change amplitude, or the like, and may be a linear change or a non-linear change, which is not limited in this embodiment.
  • the response image is composed of one or more closed curves, such as a circular, elliptical, square or irregular closed curve.
  • the closed curve can be adjusted with user input.
  • continuous user input such as voice input, character input, etc.
  • the closed curve can be dynamically adjusted according to the continuous input, that is, the response image drawn by each display frame on the smart terminal is input with the input.
  • a regular curve such as a sinusoid as a parameter.
  • the radius and the moving speed of the closed curve may be related to a user input corresponding input information, and the input information includes a volume, an input speed, an input quantity, and/or a duration.
  • the radius of the closed curve can be adjusted by the radius.
  • the moving speed includes the changing speed and the angular velocity.
  • the speed of the closed curve can be adjusted by changing the speed, and the shape of the closed curve can be adjusted by the angular velocity.
  • the length of the voice input to adjust the radius of the closed curve, the speed of movement according to the input speed of the keyboard input, the number of inputs to adjust the radius of the closed curve, the speed of motion; according to the input speed of the touch input, input The number adjusts the radius of the closed curve and the speed of movement.
  • the response image is dynamically changed in various ways to improve the interactive experience of the voice, and the user can be better prompted by the dynamically changing image to prevent the message from being ignored.
  • the embodiment is capable of receiving user input in the display interface, drawing a response image according to the user input, adding the response image to the display interface for display, and directly drawing a response image based on the user input, without the user Other operations and prompting the user for the current loss without interfering with the inherent scrolling interaction of the interface Into the state.
  • the method may include the following steps:
  • Step 202 When the voice assist control is started, the response image is displayed in the corresponding display interface of the voice assist control.
  • the voice assist control may be a system level control or a part of the system level control.
  • the system level control assists the user to perform an operation, and the user can directly input the voice through the voice assist control, and the voice assist control automatically inputs the voice. Identify and determine the required actions to assist the user in performing.
  • the response image can be displayed in the corresponding display interface of the voice assist control.
  • the response image comprises a closed curve dynamically adjusted according to a preset manner.
  • the status of the voice assist control includes: default state, input state, and read state.
  • the default state includes a silent state without input and output after startup, the input state includes a state when receiving user voice data, and the read state includes a state when voice data is input.
  • the voice assist control may draw a response image in the display interface in various states, and the response image includes a closed curve dynamically adjusted according to a preset manner, that is, a dynamically adjusted response image.
  • the adjustment basis of the response image may be different in different states: for example, the default adjustment parameter is configured in the default state, and the motion of the response image in the default state may be relatively slow, so that the user can know that the voice assist control is running, and feels similar waiting
  • the read status can determine the adjustment parameters according to the input voice data or the default configuration, and the motion of the response image in the read state can be more obvious than the default state, which is the difference between the user-perceived output and the silence, and feels like a voice-assisted control is thinking and giving customer feedback.
  • Step 204 Receive voice data by using a trigger in the display interface corresponding to the voice assist control, and input the voice data as a voice.
  • Step 206 Draw a response image composed of a closed curve according to the user input.
  • the user can trigger the input of the open voice, correspondingly receive the voice input based on the trigger of the user, use the voice input as the voice input, determine the adjustment parameter according to the voice data, and draw a closed curve according to the adjustment parameter.
  • a closed curve is used to construct a response image.
  • the screen of the intelligent terminal displays a certain number of frames per second to dynamically display the screen image.
  • the adjustment parameter is determined according to the voice input, and the corresponding parameter is drawn and closed according to the adjustment parameter.
  • the curve which constitutes a dynamically adjusted response image, is responsive to the user's input.
  • Step 208 filling a color or pattern in the response image.
  • Step 210 Set transparency of the response image.
  • the color or pattern may be filled in the response image to highlight the response image; the transparency of the response image may also be set so that the display of the response image does not affect the current interface content.
  • At least one color or at least one pattern may be added to the response image, and the response image may be filled according to any of the following filling methods, including: filling from shallow to deep, by Deep to shallow fill, cold, warm fill.
  • filling from shallow to deep by Deep to shallow fill
  • cold warm fill.
  • different curves can be filled with different colors to distinguish, such as from shallow to deep filling, from deep to shallow filling, or filling a variety of cool colors, multiple warm colors or transition through cold and warm colors. .
  • Step 212 Add the response image to the display interface for display.
  • the response image corresponding to each frame is added to the frame corresponding display interface, so that the corresponding image is displayed in the interface, and the response image also dynamically changes as the display frame changes.
  • Step 214 When playing the voice assist control corresponding to the auxiliary voice data, draw a response image according to the auxiliary voice data, and display the response image.
  • the voice input is usually input to play the auxiliary voice data
  • the adjustment parameter may be determined according to the auxiliary voice data, or the default adjustment parameter in the read state may be configured, and each display frame is drawn according to the adjustment parameter.
  • the closed curve displayed is displayed by using a closed curve to generate a corresponding response image.
  • the voice assist control can determine the adjustment parameter in the default state, the input state, and the read state, respectively, and the steps of drawing the closed curve according to the adjustment parameter are basically the same. Therefore, in this embodiment, the adjustment state is determined according to the voice state, and the adjustment parameter is drawn and closed. The curve is discussed as an example.
  • the closed curve may be a fixed shape, such as at least one of a circle, a triangle, and a polygon, that is, may be in any of the above fixed shape changes in size and position, or may be changed in the above two or more forms, such as from a triangle, a quadrangle, and a fifth.
  • the polygons such as the sides gradually change into a circle, and then change back to a triangle or the like.
  • a center and a radius may be determined according to the voice input corresponding voice data; a circular curve is drawn according to the center and the radius, and the circular curve is used to generate a response image. That is, the center and the radius are preset, and a circular curve is formed according to the preset center and radius to form a response image, and the position and/or the radius of the center of the adjustment parameter is adjusted according to the voice data, thereby adjusting the circle drawn.
  • the reference data of the adjustment curve can be adjusted according to the voice data to draw the corresponding curve.
  • the closed curve can also be a closed curve of a non-fixed shape, and the shape corresponding to the curve is adjusted according to the adjustment parameter. As shown in FIG. 3, the following sub-steps are included:
  • Sub-step 302 Acquire a preset center of the circle and at least one set of reference points on the circumference corresponding to the radius.
  • Sub-step 304 for each set of reference points, determining an adjustment parameter according to the voice input corresponding voice data, wherein the adjustment parameter includes an angular velocity adjustment parameter and/or a distance adjustment parameter.
  • Sub-step 306 adjusting coordinate information of the reference point by using a sinusoid and the adjustment parameter.
  • sub-step 308 is performed; when the coordinate information of at least two sets of reference points is determined, sub-step 312 is performed.
  • Sub-step 308 drawing a closed Saybol curve according to coordinate information of at least four reference points in a set of reference points.
  • Sub-step 310 constructing a response image using the closed Saybolt curve.
  • Sub-step 312 drawing closed Cebel curves using coordinate information of at least two sets of reference points, wherein each set of reference points includes four reference points.
  • Sub-step 314, the response image is constructed using at least two closed Sebel curves.
  • the radius can be, but this way can only produce a uniform circle / ellipse, to achieve a non-uniform shape of the approximate circle, you can use Bezier curve to form an approximate circle.
  • the adjustment parameter is determined according to the input-based voice input, and different closed Bezier curves are drawn in each frame based on the adjustment parameter, so that the dynamically adjusted response image is displayed in the display interface, so that the drawn circle is drawn. Creeping, creating a sense of life, rather than being fixed as a static circle.
  • a reference circle may be configured in advance, that is, a circle of the reference is determined by a preset center and a radius, and at least one set of reference points on the circle corresponding to the circle of the reference is determined, and each set of reference points includes four reference points. .
  • the usual graphical programming API (Application Programming Interface) has a method of drawing Bezier curves between two points, such as cubeTo in some languages and cubicCurveTo in some languages.
  • the number of parameters can include At least six, respectively, the control point x coordinate of the starting point, the starting point control point y coordinate, the end point control point x coordinate, the end point control point y coordinate, the end point x coordinate, and the end point y coordinate. Therefore, the above four reference points are also associated with two control points.
  • the radius of the circle be r
  • the calculation method of the control point coordinates is: the distance from the relevant key point is r* 0.551915024494.
  • the coordinates of p0 are (0, -r)
  • the coordinates of the control point on the left side of p0 are (-r*0.551915024494, -r)
  • the coordinates of the control point on the right side of p0 are (r*0.551915024494, -r), other controls And so on.
  • the movement of the four reference points can be made continuous and reciprocating.
  • the sinusoid is similar to a smooth oscillating wave on the image, and the sinusoidal result is circulated between -1 and 1, which can have the characteristics of continuous motion and reciprocation. Therefore, for each set of reference points, the adjustment parameter is determined according to the voice input corresponding voice data, and the coordinate information of the reference point is adjusted by using the sinusoid curve and the adjustment parameter.
  • the angular velocity adjustment parameter and/or the distance adjustment parameter are determined according to the voice data; the sinusoid is adjusted according to the angular velocity adjustment parameter and/or the distance adjustment parameter; and the coordinate information of the reference point is determined according to the adjusted sinusoid.
  • the angular velocities a, b can be given to the x-axis and y-axis coordinates of each reference point, respectively.
  • a and b can be equal or unequal, and the shape of the circle is more variable and the visual effect is better.
  • the coordinate information of each reference point in each frame is calculated as follows:
  • Math.sin is a method of calculating the sine of a parameter in a computer language.
  • startX is the initial coordinate of the reference point when no displacement occurs.
  • startX of p0 is 0, and startY is -r.
  • each frame a, b can be accumulated according to certain parameters, that is, the angular velocity adjustment parameters are respectively av, bv. Av and If bv is not equal, the shape of the circle can be changed more.
  • the distance adjustment parameter m can also be referred to as the maximum offset distance.
  • m can be configured not to exceed r*0.5. The smaller m is, the smaller the offset is. When m is 0, the coordinates of the key points will not change, and the drawn graph is a uniform perfect circle. The larger m, the more dramatic the change in the circle.
  • the volume adjustment distance when determining the volume of the voice data input by the user according to the system detection, if the volume is small, the m can be adjusted to be close to 0, and the shape is approximately a perfect circle; if the volume is large, the m trend can be adjusted. Near r*0.5, the shape deforms to some extent according to m.
  • you can also add r, v feedback for the volume the volume is small, r, v is small, the volume is large, r, v is larger. Among them, the result of the combination of deformation and size is shown in Fig. 6.
  • multiple sets of reference points may be configured to draw a response image composed of a plurality of closed Saybolt curves.
  • each set of reference points may be determined according to the adjustment parameters corresponding to the input parameters. The difference is that the values of r, m, a, b, av, and bv of each layer can be different, thereby generating a multi-layered variable response image, as shown in FIG.
  • the adjustment parameters may be determined in a default manner, or the adjustment parameters may be determined in a manner similar to the above input voice data, thereby drawing different Saybolt curves in each frame according to the adjustment parameters.
  • the drawing steps are similar to the above, and therefore will not be described again.
  • the above embodiment takes the voice input as an example, and discusses the steps of drawing and displaying a response image based on user input. In the actual processing, different adjustment parameters can be determined according to various user input characteristics to adjust the curve in the response image.
  • the adjustment parameters such as the angular velocity adjustment parameter, the distance adjustment parameter, and the radius may be adjusted based on the touch corresponding contact area, such as determining a single touch or a multi-touch, a contact area of each touch point, etc., each time the display is displayed.
  • Corresponding response image For example, for keyboard input, each adjustment parameter can be gradually incremented, so that each time a keyboard input is received, the response image is jumped on a default basis.
  • the response image can be drawn according to the prompt information, and the response step of drawing the response image according to the prompt information is similar to the above, as shown in FIG. 8.
  • Step 802 Obtain a prompt message on the current display interface.
  • Step 804 drawing a response image composed of a closed curve according to the prompt message.
  • the response image is drawn according to the prompt message, and the following sub-steps are included as shown in FIG. 9:
  • Sub-step 902 acquiring a preset center of the circle and at least one set of reference points on the circumference corresponding to the radius.
  • Sub-step 904 for each set of reference points, determining preset adjustment parameters according to the prompt message, wherein the adjustment parameters include an angular velocity adjustment parameter and/or a distance adjustment parameter.
  • Sub-step 906 adjusting coordinate information of the reference point by using a sinusoid and the adjustment parameter.
  • sub-step 908 is performed; when the coordinate information of at least two sets of reference points is determined, sub-step 912 is performed.
  • Sub-step 908 drawing a closed Saybol curve based on coordinate information of at least four of the set of reference points.
  • the response image is constructed using the closed Saybolt curve.
  • Sub-step 912 drawing closed Cebel curves using coordinate information of at least two sets of reference points, wherein each set of reference points includes four reference points.
  • the response image is constructed using at least two closed Sebel curves.
  • the change manner of the adjustment parameter may be pre-configured for the prompt message, such as according to the type of the prompt message, the length of the prompt message, and the like, or may be a default adjustment parameter, so that different games are drawn in each frame according to the adjustment parameter.
  • the Bell curve generates a response image.
  • Step 806 filling a color or pattern in the response image.
  • Step 808 setting the transparency of the response image.
  • Step 810 adding the response image to the display interface for display.
  • the response image corresponding to each frame is added to the frame corresponding display interface, so that the corresponding image is displayed in the interface, and the response image also dynamically changes as the display frame changes.
  • the prompt message exists, the user may be prompted to promptly.
  • the prompt message of the voice assist control is voice data “I have something to say”, and the current interface may obtain a prompt message and draw a response image for display, thereby being in the voice data. Based on the display, dynamic interaction can also be displayed on the interface.
  • the step of drawing the response image and displaying the prompt message is substantially the same as the step of displaying the response image according to the voice data and displaying the foregoing.
  • the step of drawing the response image and displaying the prompt message is substantially the same as the step of displaying the response image according to the voice data and displaying the foregoing.
  • the dynamically changing response image is displayed in the display interface, that is, the response image will continue to change, and the short-term prompt mode such as difference and flashing can give the user a more clear prompt to prevent the message from being ignored and promptly prompting. And in response to the dynamic changes of the image, giving the user a life-like experience and improving the user experience.
  • a circular shape in which deformation occurs is used as a response image input by the user to respond to user input.
  • the above steps can be generalized to most computer languages for CPU programming, and can also be ported to computer languages for GPU programming.
  • the embodiment further provides a processing device for interface operation.
  • FIG. 10 a structural block diagram of an embodiment of a processing apparatus for input operation of the present application is shown, which may specifically include the following modules:
  • the input receiving module 1002 is configured to receive a user input or obtain a prompt message in the display interface.
  • the drawing module 1004 is configured to draw a response image according to the user input or the prompt message.
  • the display module 1006 is configured to add the response image to the display interface for display.
  • the user input is received in the display interface, the response image is drawn according to the user input, and the response image is added to the display interface for display, and the response image can be directly drawn based on the user input, without other operations of the user.
  • the user is prompted for the current input state without disturbing the scroll interaction inherent to the interface.
  • FIG. 11A a structural block diagram of an embodiment of a processing apparatus for another input operation of the present application is shown. Specifically, the following modules may be included:
  • the input receiving module 1102 is configured to receive user input in the display interface; and obtain a prompt message in the display interface.
  • the drawing module 1104 is configured to draw a response image according to the user input; and draw a response image according to the prompt message.
  • the display module 1106 is configured to add the response image to the display interface for display.
  • the user input includes: voice input, touch input, and keyboard input.
  • the response image is a dynamically changing image; the change frequency of the response image is related to the user input corresponding input information, and/or the change amplitude of the response image is related to the user input corresponding input information;
  • the input information includes volume, input speed, number of inputs, and/or duration.
  • the change frequency is proportional to the change information of the input information; the change amplitude is proportional to the change information of the input information.
  • the response image consists of one or more closed curves.
  • the closed curve is adjusted with user input.
  • the radius of the closed curve is related to the user input corresponding input information, wherein the input information includes volume, input Speed, number of inputs, and/or duration.
  • the speed of movement of the closed curve is related to the user input corresponding input information, wherein the input information includes volume, input speed, number of inputs, and/or duration.
  • the display module is further configured to: when the voice assist control is activated, display a response image in a corresponding display interface of the voice assist control, wherein the response image includes a dynamic adjustment according to a preset manner. curve.
  • the user input includes a voice input
  • the input receiving module is configured to receive the voice data as a voice input by receiving voice data in a trigger corresponding to the voice assist control corresponding display interface.
  • the drawing module 1104 includes:
  • a first drawing sub-module 11042 configured to determine a center and a radius according to the voice input corresponding voice data; draw a circular curve according to the center and the radius, generate a response image by using the circular curve; and determine a center according to the prompt message And a radius; a circular curve is drawn according to the center and the radius, and the circular image is used to generate a response image.
  • a second drawing sub-module 11044 configured to acquire at least one set of reference points on a preset circle center and a radius corresponding circumference; adjust each group of reference points according to the voice input corresponding voice data; draw a closed curve according to at least one set of reference points, A response image is generated using the closed curve.
  • FIG. 11B a structural block diagram of a second drawing sub-module in another embodiment of a processing device for input operation of the present application is shown.
  • the second rendering sub-module 11044 includes: a parameter adjusting unit 110442, configured to determine, according to the voice input corresponding voice data, an adjustment parameter for each set of reference points, and adjust coordinate information of the reference point by using a sinusoid and the adjustment parameter. Determining an adjustment parameter according to the prompt message for each set of reference points, and adjusting coordinate information of the reference point by using a sinusoid curve and the adjustment parameter
  • the parameter adjustment unit 110442 is configured to determine an angular velocity adjustment parameter and/or a distance adjustment parameter according to the voice data; adjust the sinusoid according to the angular velocity adjustment parameter and/or the distance adjustment parameter; and determine the reference according to the adjusted sinusoid The coordinate information of the point. Determining an angular velocity adjustment parameter and/or a distance adjustment parameter according to the prompt message; adjusting the sinusoid according to an angular velocity adjustment parameter and/or a distance adjustment parameter; determining coordinate information of the reference point according to the adjusted sinusoid
  • the second rendering module 11044 includes: a rendering generating unit 110444, configured to draw a closed Saybol curve according to coordinate information of at least four reference points of the set of reference points; and use the closed Saybel curve to construct a response image.
  • the drawing generating unit 110444 is configured to respectively draw a closed game by using coordinate information of at least two sets of reference points A Bell curve in which each set of reference points includes four reference points; a response image is constructed using at least two closed Sebel curves.
  • the drawing module 1104 is further configured to: when playing the voice assisting control corresponding to the auxiliary voice data, draw the response image according to the auxiliary voice data.
  • the drawing module further includes:
  • the color filling sub-module 11046 is configured to add at least one color or at least one pattern to the response image.
  • the color filling sub-module 11046 is configured to fill the response image according to any of the following filling methods; the filling manner includes: filling from shallow to deep, filling from deep to shallow, filling with cold and warm colors.
  • the drawing module further includes:
  • the transparency setting sub-module 11048 is configured to set the transparency of the response image.
  • the volume adjustment distance when determining the volume of the voice data input by the user according to the system detection, if the volume is small, the m can be adjusted to be close to 0, and the shape is approximately a perfect circle; if the volume is large, the m trend can be adjusted. Near r*0.5, the shape deforms to some extent according to m.
  • you can also add r, v feedback for the volume the volume is small, r, v is small, the volume is large, r, v is larger. Among them, the result of the combination of deformation and size.
  • multiple sets of reference points may be configured to draw a response image composed of a plurality of closed Saybolt curves.
  • each set of reference points may be determined according to the adjustment parameters corresponding to the input parameters. The difference is that the values of r, m, a, b, av, and bv of each layer can be different, thereby generating a multi-layered variable response image.
  • the adjustment parameters may be determined in a default manner, or the adjustment parameters may be determined in a manner similar to the above input voice data, thereby drawing different Saybolt curves in each frame according to the adjustment parameters.
  • the drawing steps are similar to the above, and therefore will not be described again.
  • the above embodiment takes the voice input as an example, and discusses the steps of drawing and displaying a response image based on user input. In the actual processing, different adjustment parameters can be determined according to various user input characteristics to adjust the curve in the response image.
  • the adjustment parameters such as the angular velocity adjustment parameter, the distance adjustment parameter, and the radius may be adjusted based on the touch corresponding contact area, such as determining a single touch or a multi-touch, a contact area of each touch point, etc., each time the display is displayed.
  • Corresponding response image For example, for keyboard input, each adjustment parameter can be gradually incremented, so that each time a keyboard input is received, the response image is jumped on a default basis.
  • the dynamic change response image is displayed in the display interface, that is, the response image will continue to change, and the short-term prompt mode such as difference and flashing can give the user a clearer prompt to prevent the message from being ignored and promptly prompting. And in response to the dynamic changes of the image, giving the user a life-like experience and improving the user experience.
  • a circular shape in which deformation occurs is used as a response image input by the user to respond to user input.
  • the above steps can be generalized to most computer languages for CPU programming, and can also be ported to computer languages for GPU programming.
  • the embodiment further discloses an intelligent terminal.
  • FIG. 12 a structural block diagram of an embodiment of a smart terminal according to the present application is shown, which may specifically include the following modules:
  • the smart terminal 1200 includes a memory 1212, a display 1220, a processor 1230, and an input unit 1240.
  • the input unit 1240 can be configured to receive numeric or character information input by a user, and a control signal.
  • the input unit 1240 may include a touch screen 1241, which may collect a touch operation on or near the user (such as an operation of the user using a finger, a stylus, or the like on the touch screen 1241. ), and drive the corresponding connection device according to a preset program.
  • the input unit 1240 may also include other input devices such as a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), a mouse, and the like.
  • the display 1220 includes a display panel.
  • the display panel may be configured in the form of a liquid crystal display (LCD) or an organic light-emitting diode (OLED).
  • the touch screen can cover the display panel to form a touch display screen, and when the touch display screen detects a touch operation on or near it, it is transmitted to the processor 1230 to perform corresponding processing.
  • the processor 1230 is configured to receive a user input or obtain a prompt message in the display interface by calling a software program stored in the memory 1212, and/or a module, and/or data; The user inputs or prompts the message into the drawing response image; and adds the response image to the display interface for display.
  • the user input includes: voice input, touch input, and keyboard input.
  • the response image is a dynamically changing image; the change frequency of the response image is related to the user input corresponding input information, and/or the change amplitude of the response image is corresponding to the user input input information.
  • the input information includes volume, input speed, number of inputs, and/or duration.
  • the change frequency is proportional to the change data of the input information
  • the change amplitude is proportional to the change data of the input information
  • the response image is composed of one or more closed curves.
  • the closed curve is adjusted with user input.
  • the radius of the closed curve is related to the user input corresponding input information, wherein the input information includes a volume, an input speed, an input quantity, and/or a duration.
  • the moving speed of the closed curve is related to the user input corresponding input information, wherein the input information includes a volume, an input speed, an input quantity, and/or a duration.
  • the method further includes: displaying a response image in the corresponding display interface of the voice assist control when the voice assist control is started, wherein the response image includes a closed curve that is dynamically adjusted according to a preset manner.
  • the user input includes a voice input
  • receiving the user input in the display interface includes: receiving the voice data as a voice input by receiving the voice data in a trigger corresponding to the voice assist control corresponding to the display interface.
  • the response image is drawn according to the user input or receiving the prompt message, including: determining a center and a radius according to the prompt message or the voice input corresponding voice data; and drawing a circular curve according to the center and the radius, using the circle The shape curve generates a response image.
  • the response image is drawn according to the voice input or the receiving prompt message, including: acquiring a preset center of the circle and at least one set of reference points on the circumference corresponding to the radius; and adjusting each group according to the prompt message or the voice input corresponding voice data. a reference point; drawing a closed curve based on at least one set of reference points, and generating a response image using the closed curve.
  • adjusting each group of reference points according to the prompt message or the voice input corresponding voice data including: determining, for each group of reference points, adjusting parameters according to the prompt message or the voice input corresponding voice data, using a sinusoid and a The adjustment parameter adjusts coordinate information of the reference point.
  • drawing a closed curve according to the at least one set of reference points, and generating a response image by using the closed curve comprising: drawing a closed Saybol curve according to coordinate information of at least four reference points of the set of reference points; using the closing The Saybolt curve constitutes a response image.
  • the closed curve is drawn according to the at least one set of reference points, and the closed curve is used to generate the response image, including: drawing closed Cebel curves by using coordinate information of at least two sets of reference points, wherein each set of reference points includes four Reference points; a response image is constructed using at least two closed Sebel curves.
  • the method further includes: when playing the voice assist control corresponding to the auxiliary voice data, drawing a response image according to the auxiliary voice data, and displaying the response image.
  • the method further includes: adding at least one color or at least one pattern to the response image.
  • the method further includes: filling the response image according to any one of the following filling manners; the filling manner includes: filling from shallow to deep, filling from deep to shallow, filling with cold and warm colors.
  • the method further includes: setting a transparency of the response image.
  • the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.
  • embodiments of the embodiments of the present application can be provided as a method, apparatus, or computer program product. Therefore, the embodiments of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Moreover, embodiments of the present application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
  • the computer device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
  • the memory may include non-persistent memory, random access memory (RAM), and/or non-volatile memory in a computer readable medium, such as read only memory (ROM) or flash memory.
  • RAM random access memory
  • ROM read only memory
  • Memory is an example of a computer readable medium.
  • Computer readable media includes both permanent and non-persistent, removable and non-removable media.
  • Information storage can be implemented by any method or technology. The information can be computer readable instructions, data structures, modules of programs, or other data.
  • Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory. (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape storage or other magnetic storage devices or any other non-transportable media can be used to store information that can be accessed by a computing device.
  • computer readable media does not include non-persistent computer readable media, such as modulated data signals and carrier waves.
  • Embodiments of the present application are described with reference to flowcharts and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG.
  • These computer program instructions can be provided to a processor of a general purpose computer, a special purpose computer, an embedded processor or other programmable data processing terminal device to produce a machine such that it is provided by a computer or other programmable data processing terminal
  • the instructions executed by the processor of the processor generate means for implementing the functions specified in one or more blocks of the flowchart or in a block or blocks of the flowchart.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing terminal device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the instruction device implements the functions specified in one or more blocks of the flowchart or in a flow or block of the flowchart.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种输入操作的处理方法、装置和智能终端。所述的方法包括:在显示界面内接收用户输入或获取提示消息(102);依据所述用户输入或提示消息绘制响应图像(104);将所述响应图像添加到所述显示界面中进行显示(106)。直接依据用户输入或提示消息绘制响应图像,无需用户其他操作且在不干扰界面固有的滚动交互的前提下,对用户进行提示,解决了现有技术中无法获知输入情况的问题。

Description

输入操作的处理方法、装置和智能终端
本申请要求2015年12月09日递交的申请号为201510907810.X、发明名称为“输入操作的处理方法、装置和智能终端”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端技术领域,特别是涉及一种输入操作的处理方法、一种输入操作的处理装置,以及一种智能终端。
背景技术
用户使用PC或移动终端等计算机设备时,通常会采用显示界面展示内容给用户,用户也可以在该显示界面中对内容进行查找、查看、操作等。
用户通常通过输入与设备进行交互,如文字输入、语音输入等,但是,设备往往仅是对输入进行接收,用户难以获知输入的具体情况。例如,在录入语音时往往点击按键开始录音,此后并没有明确标识显示是否正在录音,可能在需要会话接收后才发现语音录入失败。并且,大部分录音场景是不可重复的,一旦录入失败就无法挽回。
发明内容
本申请实施例所要解决的技术问题是提供一种输入操作的处理方法,以解决现有无法获知输入情况的问题。
相应的,本申请实施例还提供了一种输入操作的处理装置和移动终端,用以保证上述方法的实现及应用。
为了解决上述问题,本申请公开了一种输入操作的处理方法,包括:在显示界面内接收用户输入或获取提示消息;依据所述用户输入或提示消息绘制响应图像;将所述响应图像添加到所述显示界面中进行显示。
可选的,所述用户输入包括:语音输入、触摸输入和键盘输入。
可选的,所述响应图像为动态变化的图像;所述响应图像的变化频率与所述用户输入对应输入信息相关,和/或,所述响应图像的变化幅度与所述用户输入对应输入信息相关;其中,所述输入信息包括音量、输入速度、输入数量和/或时长。
可选的,所述变化频率与所述输入信息的变化数据成正比;所述变化幅度与所述输 入信息的变化数据成正比。
可选的,所述响应图像由一条或多条闭合曲线构成。
可选的,所述闭合曲线随用户输入调整。
可选的,所述闭合曲线的半径与所述用户输入对应输入信息相关,其中,所述输入信息包括音量、输入速度、输入数量和/或时长。
可选的,所述闭合曲线的运动速度与所述用户输入对应输入信息相关,其中,所述输入信息包括音量、输入速度、输入数量和/或时长。
可选的,还包括:启动语音辅助控件时,在语音辅助控件对应显示界面内显示响应图像,其中,所述响应图像包括按照预置方式动态调整的闭合曲线。
可选的,所述用户输入包括语音输入,在显示界面内接收用户输入,包括:通过对所述语音辅助控件对应显示界面内的触发接收语音数据,将所述语音数据作为语音输入。
可选的,依据所述用户输入或接收提示消息绘制响应图像,包括:依据所述提示消息或语音输入对应语音数据确定圆心和半径;依据所述圆心和半径绘制圆形曲线,采用所述圆形曲线生成响应图像。
可选的,依据所述语音输入或接收提示消息绘制响应图像,包括:获取预置的圆心和半径对应圆周上的至少一组基准点;依据所述提示消息或语音输入对应语音数据调整各组基准点;依据至少一组基准点绘制闭合曲线,采用所述闭合曲线生成响应图像。
可选的,依据所述提示消息或语音输入对应语音数据调整各组基准点,包括:针对每一组基准点,依据所述提示消息或语音输入对应语音数据确定调整参数,采用正弦曲线和所述调整参数调整所述基准点的坐标信息。
可选的,依据所述提示消息或语音输入对应语音数据确定调整参数,采用正弦曲线和所述调整参数调整所述基准点,包括:依据所述提示消息或语音数据,确定角速度调整参数和/或距离调整参数;依据角速度调整参数和/或距离调整参数对所述正弦曲线进行调整;依据调整的正弦曲线确定所述基准点的坐标信息。
可选的,依据至少一组基准点绘制闭合曲线,采用所述闭合曲线生成响应图像,包括:依据一组基准点中至少四个基准点的坐标信息绘制闭合的赛贝尔曲线;采用所述闭合的赛贝尔曲线构成响应图像。
可选的,依据至少一组基准点绘制闭合曲线,采用所述闭合曲线生成响应图像,包括:采用至少两组基准点的坐标信息分别绘制闭合的赛贝尔曲线,其中,每组基准点包括四个基准点;采用至少两条闭合的赛贝尔曲线构成响应图像。
可选的,还包括:播放语音辅助控件对应辅助语音数据时,依据所述辅助语音数据绘制响应图像,显示所述响应图像。
可选的,还包括:在所述响应图像中添加至少一种颜色或至少一种图案。
可选的,还包括:按照以下任一种填充方式填充所述响应图像;所述填充方式包括:由浅到深填充,由深到浅填充,冷、暖色填充。
可选的,还包括:设置所述响应图像的透明度。
本申请实施例还公开了一种输入操作的处理装置,包括:输入接收模块,用于在显示界面内接收用户输入或获取提示消息;绘制模块,用于依据所述用户输入或提示消息绘制响应图像;显示模块,用于将所述响应图像添加到所述显示界面中进行显示。
可选的,所述用户输入包括:语音输入、触摸输入和键盘输入。
可选的,所述响应图像为动态变化的图像;所述响应图像的变化频率与所述用户输入对应输入信息相关,和/或,所述响应图像的变化幅度与所述用户输入对应输入信息相关;其中,所述输入信息包括音量、输入速度、输入数量和/或时长。
可选的,所述变化频率与所述输入信息的变化数据成正比;所述变化幅度与所述输入信息的变化数据成正比。
可选的,所述响应图像由一条或多条闭合曲线构成。
可选的,所述闭合曲线随用户输入调整。
可选的,所述闭合曲线的半径与所述用户输入对应输入信息相关,其中,所述输入信息包括音量、输入速度、输入数量和/或时长。
可选的,所述闭合曲线的运动速度与所述用户输入对应输入信息相关,其中,所述输入信息包括音量、输入速度、输入数量和/或时长。
可选的,所述显示模块,还用于启动语音辅助控件时,在语音辅助控件对应显示界面内显示响应图像,其中,所述响应图像包括按照预置方式动态调整的闭合曲线。
可选的,所述用户输入包括语音输入,所述输入接收模块,用于通过对所述语音辅助控件对应显示界面内的触发接收语音数据,将所述语音数据作为语音输入。
可选的,所述绘制模块,包括:第一绘制子模块,用于依据所述提示消息或语音输入对应语音数据确定圆心和半径;依据所述圆心和半径绘制圆形曲线,采用所述圆形曲线生成响应图像。
可选的,所述绘制模块,包括:第二绘制子模块,用于获取预置的圆心和半径对应圆周上的至少一组基准点;依据所述提示消息或语音输入对应语音数据调整各组基准点; 依据至少一组基准点绘制闭合曲线,采用所述闭合曲线生成响应图像。
可选的,第二绘制子模块,包括:参数调整单元,用于针对每一组基准点,依据所述提示消息或语音输入对应语音数据确定调整参数,采用正弦曲线和所述调整参数调整所述基准点的坐标信息。
可选的,所述参数调整单元,用于依据所述提示消息或语音数据,确定角速度调整参数和/或距离调整参数;依据角速度调整参数和/或距离调整参数对所述正弦曲线进行调整;依据调整的正弦曲线确定所述基准点的坐标信息。
可选的,第二绘制子模块,包括:绘制生成单元,用于依据一组基准点中至少四个基准点的坐标信息绘制闭合的赛贝尔曲线;采用所述闭合的赛贝尔曲线构成响应图像。
可选的,第二绘制子模块,包括:绘制生成单元,用于采用至少两组基准点的坐标信息分别绘制闭合的赛贝尔曲线,其中,每组基准点包括四个基准点;采用至少两条闭合的赛贝尔曲线构成响应图像。
可选的,所述绘制模块,还用于播放语音辅助控件对应辅助语音数据时,依据所述辅助语音数据绘制响应图像。
可选的,所述绘制模块,还包括:颜色填充子模块,用于在所述响应图像中添加至少一种颜色或至少一种图案。
可选的,所述绘制模块,还包括:颜色填充子模块,用于按照以下任一种填充方式填充所述响应图像;所述填充方式包括:由浅到深填充,由深到浅填充,冷、暖色填充。
可选的,所述绘制模块,还包括:透明度设置子模块,用于设置所述响应图像的透明度。
本申请实施例还公开了一种智能终端,包括:所述智能终端包括:存储器、显示器、处理器和输入单元,其中,所述输入单元包括:触摸屏;所述处理器用于执行本申请实施例所述的方法。
与现有技术相比,本申请实施例包括以下优点:
在本申请实施例中,在显示界面内接收用户输入或获取提示消息,依据所述用户输入或提示消息绘制响应图像,将所述响应图像添加到所述显示界面中进行显示,能够直接基于提示消息或用户输入绘制响应图像,无需用户其他操作且在不干扰界面固有的滚动交互的前提下,对用户进行提示。
附图说明
图1是本申请的一种输入操作的处理方法实施例的步骤流程图;
图2是本申请的一种语音输入的处理方法实施例的步骤流程图;
图3是本申请的一种语音输入的处理方法实施例中绘制调整曲线的步骤流程图;
图4是本申请实施例中基准点的确定示意图;
图5是本申请实施例中调整基准点绘制的闭合曲线示意图;
图6是本申请实施例中动态调整基准点绘制动态闭合曲线的示意图;
图7是本申请实施例中调整基准点绘制多层动态闭合曲线的示意图;
图8是本申请的一种提示消息的处理方法实施例的步骤流程图;
图9是本申请的一种提示消息的处理方法实施例中绘制调整曲线的步骤流程图;
图10是本申请一种输入操作的处理装置实施例的结构框图;
图11A是本申请另一种输入操作的处理装置实施例的结构框图;
图11B是本申请另一种输入操作的处理装置实施例中第二绘制子模块的结构框图;
图12是本申请一种智能终端实施例的结构框图。
具体实施方式
为使本申请的上述目的、特征和优点能够更加明显易懂,下面结合附图和具体实施方式对本申请作进一步详细的说明。
本申请实施例的核心构思之一在于,提出一种输入操作的处理方法、装置和智能终端,以解决现有无法获知输入情况的问题。在显示界面内接收用户输入或获取提示消息,依据所述用户输入或提示消息绘制响应图像,将所述响应图像添加到所述显示界面中进行显示,能够直接基于用户输入或提示消息绘制响应图像,无需用户其他操作且在不干扰界面固有的滚动交互的前提下,对用户进行提示。
本申请实施例中,智能终端指的是具有多媒体功能的终端设备,这些设备支持音频、视频、数据等方面的功能。本实施例中该智能终端具有触摸屏,包括智能移动终端如智能手机、平板电脑、可穿戴设备,也可以是具有触摸屏的智能电视、个人计算机等设备。
实施例一
参照图1,示出了本申请的一种输入操作的处理方法实施例的步骤流程图,具体可以包括如下步骤:
步骤102,在显示界面内接收用户输入或获取提示消息。
用户通过输入可以与智能终端进行交互,使得智能终端执行相应的响应操作,因此用户可以直接通过手指、触摸笔等方式执行触摸操作进行输入,也可以通过对按钮、按键等物理控件的触发进行输入,智能终端在当前的显示界面内相应接收用户输入。智能终端也可以存在需要提醒用户的提示消息,则可以显示界面可以获取提示消息,例如用户订阅、查询内容更新的提示消息等。
本申请实施例中,用户输入包括:语音输入、触摸输入和键盘输入,提示消息包括语音消息。
语音输入包括智能终端录入语音数据的输入,例如通过点击当前界面中按钮后接收的语音数据,又如在某些应用、控件中接收的语音输入,如录音应用,又如语音辅助控件等。
触摸输入包括在智能终端触摸屏中触摸对应输入,如手指点击、滑动等操作。
键盘输入包括在智能终端对应键盘接收的输入,该键盘包括实体键盘和虚拟键盘等各种键盘,例如通过点击键盘输入字符的操作。
步骤104,依据所述用户输入绘制响应图像或接收提示消息。
步骤106,将所述响应图像添加到所述显示界面中进行显示。
本实施例中,依据用户输入可以执行相应的操作,当基于用户输入可以绘制响应图像,提示消息可以提示用户要获知的内容,因此在接收到提示消息后也可以基于该提示消息绘制响应图像,响应图像可以包括响应用户输入或提示消息而绘制并显示的,用于提示用户当前的输入状态或当前存在需要提醒的内容等,因此在绘制完响应图像后,可以将响应图像添加到所述显示界面中进行显示,对用户进行提示。从而在当前界面中可以显示出响应图像,给出用户动态交互体验。
另外,提示消息往往通过提示音提示一次,或在界面中闪现时间比较短,容易被用户忽略,可能出现提示不及时的问题。本实施例中显示界面在获取提示消息后可以绘制响应图像进行显示,用户提示较长时间,防止被忽略也能够及时提示用户。
本实施例中,用户输入可以是持续性的,也可以是瞬时的,依据用户输入的不同可以显示各种响应图像,例如在持续的语音输入是可以显示动态的响应图像,又如对于点击输入每次点击即绘制响应图像。
本申请一个可选实施例中,所述响应图像为动态变化的图像;如按照贝塞尔曲线等图像绘制方法绘制的一条或多条曲线,可以是具有特定特征的曲线,如正弦、余弦曲线,也可以是随意变换的曲线。
所述响应图像的变化频率与所述用户输入对应输入信息相关,和/或,所述响应图像的变化幅度与所述用户输入对应输入信息相关;由于响应图像是变化的,因此该响应图像通常可以按照一定的频率或幅度变化,其变化频率、变化幅度可以与用户输入相关,从而该变化频率、变化幅度可以是非线性变化,其中,所述输入信息包括音量、输入速度、输入数量和/或时长。则依据音量、输入速度、输入数量和/或时长等变化频率或幅度。
可选的,所述变化频率与所述输入信息的变化数据成正比;所述变化幅度与所述输入信息的变化数据成正比。输入信息通常不是一成不变的,如语音输入的音量和时长会随着输入变更,触摸输入、键盘输入的输入速度、输入数量会随着输入变更,因此将输入信息的变更生成变化数据,该变化数据通过预置方式确定的,如变化数据为音量变大、输入变慢、时长递增等。相应变化频率、变化幅度可以与变化数据成正比,如音量变大则变化频率、变化幅度增大,输入变慢则变化频率、变化幅度减慢。
而对于提示消息对应绘制的响应图像,其可以按照预置的变化频率、变化幅度等变化,可以是线性变化也可以是非线性变化,本实施例对此不作限定。
本申请一个可选实施例中,所述响应图像由一条或多条闭合曲线构成,如圆形、椭圆形、方形或不规则的闭合曲线等。该闭合曲线可以随用户输入调整,对于持续性的用户输入如语音输入,字符输入等,该闭合曲线可以依据输入的持续进行动态调整,即智能终端上每个显示帧上述绘制的响应图像随输入变化,如变更大小、形状等,还可以采用具有规律曲线如正弦曲线等作为参数调整响应图像。
其中,所述闭合曲线的半径、运动速度可以与用户输入对应输入信息相关,所述输入信息包括音量、输入速度、输入数量和/或时长。其中,通过半径可以调整闭合曲线的大小,运动速度包括变化速度和角速度等,通过变化速度可以调整闭合曲线快慢,通过角速度可以调整闭合曲线的形状。
如根据语音输入对应语音输入的音量大小、语音输入的时长调整闭合曲线的半径、运动速度;根据键盘输入的输入速度、输入数量调整闭合曲线的半径、运动速度;根据触摸输入的输入速度、输入数量调整闭合曲线的半径、运动速度。
通过各种方式使响应图像实现动态变化,从而提高语音的交互体验,还能通过动态变化的图像更好的提示用户,防止消息被忽略。
因此,本实施例能够在显示界面内接收用户输入,依据所述用户输入绘制响应图像,将所述响应图像添加到所述显示界面中进行显示,能够直接基于依据用户输入绘制响应图像,无需用户其他操作且在不干扰界面固有的滚动交互的前提下,提示用户当前的输 入状态。
实施例二
以语音输入作为用户输入为例,论述输入操作的响应处理步骤。
参照图2,示出了本申请的一种语音输入的处理方法实施例的步骤流程图,具体可以包括如下步骤:
步骤202,启动语音辅助控件时,在语音辅助控件对应显示界面内显示响应图像。
本实施例中,语音辅助控件可以是系统级控件或该系统级控件的一部分,通过该系统级控件辅助用户执行操作,用户可以通过该语音辅助控件直接录入语音,该语音辅助控件自动对语音输入进行识别,确定所需操作来辅助用户执行。用户在使用语音辅助控件时,为了给用户更好的体验,感受人机交互,可以在语音辅助控件对应显示界面内显示响应图像。其中,所述响应图像包括按照预置方式动态调整的闭合曲线。
语音辅助控件的状态包括:默认状态、输入状态和读取状态。其中,默认状态包括启动后无输入和输出的静默状态,输入状态包括接收用户语音数据时的状态,读取状态包括输入语音数据时的状态。
本申请实施例中,语音辅助控件处于各种状态下均可以在显示界面中绘制响应图像,且该响应图像包括按照预置方式动态调整的闭合曲线,即为动态调整的响应图像。但是,在不同状态下响应图像的调整依据可以不同:例如在默认状态下配置默认的调整参数,且默认状态下响应图像的运动可以比较缓慢,使用户能够获知语音辅助控件正在运行,感觉类似等待用户下发指令;在输入状态可以依据用户语音数据输入的时间、音量、音调等确定调整参数,使响应图像配合输入显示,使用户能够获知语音辅助控件接收语音输入,感觉类似聆听用户的指令;读取状态可以依据输入语音数据或者默认配置确定调整参数,且读取状态下响应图像的运动可以比默认状态更明显,是用户感知输出和静默的区别,感觉类似语音辅助控件在思考并给出用户反馈。
步骤204,通过对所述语音辅助控件对应显示界面内的触发接收语音数据,将所述语音数据作为语音输入。
步骤206,依据所述用户输入绘制由闭合曲线构成的响应图像。
在语音辅助控件对应显示界面内,用户可以触发开启语音的录入,相应基于用户的触发接收语音输入,将该语音输入作为语音输入,依据该语音数据确定调整参数,依据该调整参数绘制闭合曲线,采用闭合曲线构成响应图像。
本实施例中,智能终端的屏幕每秒显示一定数量的帧以动态显示屏幕画面,在接收语音输入的过程中,依据语音输入确定出调整参数,依据该调整参数在每个显示帧对应绘制闭合曲线,从而构成动态调整的响应图像来响应用户的输入。
步骤208,在所述响应图像中填充颜色或图案。
步骤210,设置所述响应图像的透明度。
采用闭合曲线构成响应图像后,可以在响应图像中填充颜色或图案,从而突出该响应图像;还可以设置响应图像的透明度,以使响应图像的显示不影响当前的界面内容。
在填充响应图像时,可以在所述响应图像中添加至少一种颜色或至少一种图案,也可以按照以下任一种填充方式填充所述响应图像,该填充方式包括:由浅到深填充,由深到浅填充,冷、暖色填充。当由多条曲线和边界构成响应图像时,不同曲线间可以填充不同颜色进行区分,如由浅到深填充,由深到浅填充,或者填充多种冷色,多种暖色或者通过冷、暖色进行过渡。
步骤212,将所述响应图像添加到所述显示界面中进行显示。
将各帧对应绘制的响应图像添加到该帧对应显示界面中,从而在界面中显示相应图像,随着显示帧的变化,响应图像也动态变化。
步骤214,播放语音辅助控件对应辅助语音数据时,依据所述辅助语音数据绘制响应图像,显示所述响应图像。
语音辅助控件处于读取状态时,通常会输入语音输入即播放辅助语音数据,可以依据该辅助语音数据确定调整参数,或者配置读取状态下默认的调整参数,依据该调整参数绘制各显示帧中显示的闭合曲线,采用闭合曲线生成相应的响应图像进行显示。
本实施例中,语音辅助控件在默认状态、输入状态和读取状态分别可以确定调整参数,依据调整参数绘制闭合曲线的步骤基本一致,因此本实施例以输入状态依据语音数据确定调整参数绘制闭合曲线为例进行论述。
闭合曲线可以为固定形状,如圆形、三角形、多边形中至少一种,即可以处于上述任一固定形状变化大小和位置,也可以在上述两种以上形态中变化,如从三角形,四边形、五边形等多边形逐渐变化成圆形,再变化回三角形等。
以圆形为例,可以依据所述语音输入对应语音数据确定圆心和半径;依据所述圆心和半径绘制圆形曲线,采用所述圆形曲线生成响应图像。即预置圆心和半径,依据预置的圆心和半径绘制圆形曲线构成响应图像,依据语音数据确定调整参数调整圆心的位置和/或半径大小,从而调整绘制的圆形。
在多种固定状态对应曲线变化时,可以依据语音数据确定调整参数调整绘制曲线的基准数据,从而绘制相应的曲线。
闭合曲线也可以为非固定形状的闭合曲线,依据调整参数调整曲线对应的形状,如图3所示包括如下子步骤:
子步骤302,获取预置的圆心和半径对应圆周上的至少一组基准点。
子步骤304,针对每一组基准点,依据语音输入对应语音数据确定调整参数,其中,调整参数包括角速度调整参数和/或距离调整参数。
子步骤306,采用正弦曲线和所述调整参数调整所述基准点的坐标信息。
当确定一组基准点的坐标信息,执行子步骤308;当确定至少两组基准点的坐标信息,执行子步骤312。
子步骤308,依据一组基准点中至少四个基准点的坐标信息绘制闭合的赛贝尔曲线。
子步骤310,采用所述闭合的赛贝尔曲线构成响应图像。
子步骤312,采用至少两组基准点的坐标信息分别绘制闭合的赛贝尔曲线,其中,每组基准点包括四个基准点。
子步骤314,采用至少两条闭合的赛贝尔曲线构成响应图像。
通常在计算机绘图中绘制圆形只需指定圆心,半径即可,但此种方式只能产生均匀的圆形/椭圆,要达到非均匀形态的近似圆,可以采用贝塞尔曲线构成近似圆。其中,为了响应语音输入,依据基于输入的语音输入确定调整参数,基于该调整参数在各帧绘制不同闭合的贝塞尔曲线,从而在显示界面中显示动态调整的响应图像,使得绘制的圆形蠕动起来,产生生命感,而不是固定为一个静态圆形。
其中,预先可以配置一个基准的圆形,即通过预置圆心和半径确定基准的圆形,并且确定该基准的圆形对应圆周上的至少一组基准点,每组基准点包括四个基准点。
如图4所示,在基准的圆形的圆周上下左右4个基准点点,绘制穿过这4个关键点的贝塞尔曲线连成圆,以顺时针方向设这4个点为p0,p1,p2,p3。
通常的图形编程API(Application Programming Interface,应用程序编程接口)都带有在两点间绘制贝塞尔曲线的方法,如有的语言中叫做cubicTo,有的语言中叫做cubicCurveTo,参数的数量可以包括至少6个,分别为起点的控制点x坐标,起点控制点y坐标,终点控制点x坐标,终点控制点y坐标,终点x坐标,终点y坐标。因此上述4个基准点还各自关联2个控制点。
设圆的半径为r,控制点坐标的计算方法为:距离相关关键点距离为r* 0.551915024494。例如p0的坐标为(0,-r),那么p0左侧的控制点坐标为(-r*0.551915024494,-r),p0右侧的控制点坐标为(r*0.551915024494,-r),其他控制点以此类推。
p0到p1,p1到p2,p2到p3,p3到p0,4条贝塞尔曲线围成一个均匀正圆,若要绘制非均匀近似圆,如图5所示,可以略微移动4个基准点的坐标信息,其中,基准点坐标信息的移动,也意味着与之关联的控制点对应坐标信息移动,控制点保持在关键点两侧或两端。
本实施例中,还可以在各帧调整绘制的闭合的赛贝尔曲线,从而要让圆有生命感的发生蠕动。本实施例中,可以让4个基准点的运动连贯且具有往复性。其中,正弦曲线在图像上类似一条平滑的震荡波,正弦结果的值在-1~1之间循环,可以具有运动连贯且往复的特征。因此,针对每一组基准点,依据语音输入对应语音数据确定调整参数,采用正弦曲线和所述调整参数调整所述基准点的坐标信息。即依据语音数据确定角速度调整参数和/或距离调整参数;依据角速度调整参数和/或距离调整参数对所述正弦曲线进行调整;依据调整的正弦曲线确定所述基准点的坐标信息。
依据语音数据调整各帧对应角速度调整参数,也可以依据语音数据调整各帧对应距离调整参数,然后依据该角速度调整参数和/或距离调整参数对所述正弦曲线进行调整,本实施例调整参数还包括半径,因此还可以调整依据语音数据调整各帧对应圆形的半径,从而依据调整的半径、调整的正弦曲线确定所述基准点的坐标信息。
因此可以为每个基准点的x轴,y轴坐标分别赋予角速度a,b。其中,a与b可以相等,也可以不相等,不相等的情况下圆的形态更加多变,视觉效果更好。那么每个基准点在每帧的坐标信息计算方法如下:
a+=av;
b+=bv;
x=startX+Math.sin(a)*m;
y=startY+Math.sin(b)*m;
其中,Math.sin是一个计算机语言中计算参数正弦值的方法。
startX,startY为基准点在未发生位移时的初始坐标,例如p0的startX为0,startY为-r。
其中,每帧a,b可以按照一定参数累加,即角速度调整参数分别为av,bv。av与 bv如果不相等同样可以让圆的形态更加多变。
距离调整参数m也可称为最大的偏移距离,为了让变形之后的圆依然近似为圆,m可以配置不超过r*0.5。m越小,偏移越小,当m为0时,关键点的坐标不会发生变化,绘制出的图形为均匀正圆。m越大,圆形的变化越剧烈。
以基于音量调整距离调整参数为例,当依据系统检测确定用户输入语音数据的音量时,若音量很小,可以调整m趋近于0,形状近似正圆;若音量很大,可以调整m趋近于r*0.5,形状根据m发生一定程度形变。此外除了利用m产生的形变对于音量反馈,还可以加上r、v对于音量的反馈,音量小的情况,r、v较小,音量大,r、v较大。其中,形变与大小共同作用的结果如图6所示。
本实施例中,还可以配置多组基准点,从而绘制由多条闭合的赛贝尔曲线构成的响应图像,其中,为了让视觉效果更加丰富,每组基准点依据输入参数对应确定的调整参数可以不同,即每层的r,m,a,b,av,bv的值都可以不同,从而生成多层多变的响应图像,如图7所示。
上述论述了基于用户输入的语音数据确定调整参数,从而在每帧绘制不同的赛贝尔曲线进行响应的步骤。而在语音辅助控件在默认状态和读取状态时,可以按照默认的方式确定调整参数,或者与上述输入语音数据类似的方式确定调整参数,从而依据调整参数在每帧绘制不同的赛贝尔曲线进行响应,绘制步骤与上述类似,因此不再赘述。
上述实施例以语音输入为例,论述了基于用户输入绘制并显示响应图像的步骤。实际处理中,可以依据各种不同用户输入的特征,确定不同的调整参数进行响应图像中曲线的调整。
例如,对于触摸输入,可以基于触摸对应接触面积调整角速度调整参数、距离调整参数以及半径等调整参数,如确定单点触摸或多点触摸,每个触摸点的接触面积等,每触摸一次,显示相应的响应图像。又如对于键盘输入,可以各调整参数可以逐渐递增,从而每接收一次键盘输入,响应图像都在默认基础上跳变等。
为给用户更好的提示,防止消息被忽略并及时提示用户查阅,可以依据提示信息绘制响应图像,依据提示信息绘制响应图像进行响应的步骤与上述类似,如图8所示。
步骤802,在当前显示界面获取提示消息。
步骤804,依据所述提示消息绘制由闭合曲线构成的响应图像。
依据所述提示消息绘制响应图像绘制,如图9所示包括如下子步骤:
子步骤902,获取预置的圆心和半径对应圆周上的至少一组基准点。
子步骤904,针对每一组基准点,依据提示消息确定预置的调整参数,其中,调整参数包括角速度调整参数和/或距离调整参数。
子步骤906,采用正弦曲线和所述调整参数调整所述基准点的坐标信息。
当确定一组基准点的坐标信息,执行子步骤908;当确定至少两组基准点的坐标信息,执行子步骤912。
子步骤908,依据一组基准点中至少四个基准点的坐标信息绘制闭合的赛贝尔曲线。
子步骤910,采用所述闭合的赛贝尔曲线构成响应图像。
子步骤912,采用至少两组基准点的坐标信息分别绘制闭合的赛贝尔曲线,其中,每组基准点包括四个基准点。
子步骤914,采用至少两条闭合的赛贝尔曲线构成响应图像。
本实施例中,针对提示消息可以预先配置调整参数的变化方式,如依据提示消息的类型、提示消息的长短等配置,也可以是默认的调整参数,从而依据调整参数在每帧绘制不同的赛贝尔曲线生成响应图像。
步骤806,在所述响应图像中填充颜色或图案。
步骤808,设置所述响应图像的透明度。
步骤810,将所述响应图像添加到所述显示界面中进行显示。
将各帧对应绘制的响应图像添加到该帧对应显示界面中,从而在界面中显示相应图像,随着显示帧的变化,响应图像也动态变化。
在存在提示消息时可以主动对用户进行提示,例如上述语音辅助控件的提示消息为语音数据“我有话要说”,则当前界面可以获取提示消息并绘制响应图像进行显示,从而在语音数据的基础上还可以在界面上显示动态交互。
获取提示消息后绘制响应图像并显示的步骤,与上述依据语音数据绘制响应图像并显示的步骤基本一致,详细参见上述实施例即可,因此不再赘述。
从而在显示界面中显示动态变化的响应图像,即响应图像会持续变化,区别与闪现等时间较短的提示方式,能够给用户更加明确的提示,防止消息被忽略,能够及时进行提示。且响应图像动态变化,给用户以富有生命力的感受,提高用户体验。
本实施例中,使用会发生形变的圆形作为用户输入的响应图像,以对用户输入进行响应。上述步骤可以通用于多数针对CPU编程的计算机语言,还可以移植到针对GPU编程的计算机语言。
需要说明的是,对于方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本申请实施例并不受所描述的动作顺序的限制,因为依据本申请实施例,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作并不一定是本申请实施例所必须的。
实施例三
在上述实施例的基础上,本实施例还提供了一种界面操作的处理装置。
参照图10,示出了本申请一种输入操作的处理装置实施例的结构框图,具体可以包括如下模块:
输入接收模块1002,用于在显示界面内接收用户输入或获取提示消息。
绘制模块1004,用于依据所述用户输入或提示消息绘制响应图像。
显示模块1006,用于将所述响应图像添加到所述显示界面中进行显示。
综上,在显示界面内接收用户输入,依据所述用户输入绘制响应图像,将所述响应图像添加到所述显示界面中进行显示,能够直接基于依据用户输入绘制响应图像,无需用户其他操作且在不干扰界面固有的滚动交互的前提下,提示用户当前的输入状态。
参照图11A,示出了本申请另一种输入操作的处理装置实施例的结构框图,具体可以包括如下模块:
输入接收模块1102,用于在显示界面内接收用户输入;以及在显示界面内获取提示消息。
绘制模块1104,用于依据所述用户输入绘制响应图像;依据所述提示消息绘制响应图像。
显示模块1106,用于将所述响应图像添加到所述显示界面中进行显示。
其中,所述用户输入包括:语音输入、触摸输入和键盘输入。
所述响应图像为动态变化的图像;所述响应图像的变化频率与所述用户输入对应输入信息相关,和/或,所述响应图像的变化幅度与所述用户输入对应输入信息相关;其中,所述输入信息包括音量、输入速度、输入数量和/或时长。
所述变化频率与所述输入信息的变化信息成正比;所述变化幅度与所述输入信息的变化信息成正比。
所述响应图像由一条或多条闭合曲线构成。所述闭合曲线随用户输入调整。所述闭合曲线的半径与所述用户输入对应输入信息相关,其中,所述输入信息包括音量、输入 速度、输入数量和/或时长。所述闭合曲线的运动速度与所述用户输入对应输入信息相关,其中,所述输入信息包括音量、输入速度、输入数量和/或时长。
本申请一个可选实施例中,所述显示模块,还用于启动语音辅助控件时,在语音辅助控件对应显示界面内显示响应图像,其中,所述响应图像包括按照预置方式动态调整的闭合曲线。
所述用户输入包括语音输入,所述输入接收模块,用于通过对所述语音辅助控件对应显示界面内的触发接收语音数据,将所述语音数据作为语音输入。
其中,所述绘制模块1104,包括:
第一绘制子模块11042,用于依据所述语音输入对应语音数据确定圆心和半径;依据所述圆心和半径绘制圆形曲线,采用所述圆形曲线生成响应图像;依据所述提示消息确定圆心和半径;依据所述圆心和半径绘制圆形曲线,采用所述圆形曲线生成响应图像。
第二绘制子模块11044,用于获取预置的圆心和半径对应圆周上的至少一组基准点;依据所述语音输入对应语音数据调整各组基准点;依据至少一组基准点绘制闭合曲线,采用所述闭合曲线生成响应图像。获取预置的圆心和半径对应圆周上的至少一组基准点;依据所述提示消息调整各组基准点;依据至少一组基准点绘制闭合曲线,采用所述闭合曲线生成响应图像
参照图11B,示出了本申请另一种输入操作的处理装置实施例中第二绘制子模块的结构框图。
第二绘制子模块11044,包括:参数调整单元110442,用于针对每一组基准点,依据语音输入对应语音数据确定调整参数,采用正弦曲线和所述调整参数调整所述基准点的坐标信息。针对每一组基准点,依据所述提示消息确定调整参数,采用正弦曲线和所述调整参数调整所述基准点的坐标信息
所述参数调整单元110442,用于依据语音数据确定角速度调整参数和/或距离调整参数;依据角速度调整参数和/或距离调整参数对所述正弦曲线进行调整;依据调整的正弦曲线确定所述基准点的坐标信息。依据所述提示消息确定角速度调整参数和/或距离调整参数;依据角速度调整参数和/或距离调整参数对所述正弦曲线进行调整;依据调整的正弦曲线确定所述基准点的坐标信息
第二绘制模块11044,包括:绘制生成单元110444,用于依据一组基准点中至少四个基准点的坐标信息绘制闭合的赛贝尔曲线;采用所述闭合的赛贝尔曲线构成响应图像。
所述绘制生成单元110444,用于采用至少两组基准点的坐标信息分别绘制闭合的赛 贝尔曲线,其中,每组基准点包括四个基准点;采用至少两条闭合的赛贝尔曲线构成响应图像。
所述绘制模块1104,还用于播放语音辅助控件对应辅助语音数据时,依据所述辅助语音数据绘制响应图像。
所述绘制模块,还包括:
颜色填充子模块11046,用于在所述响应图像中添加至少一种颜色或至少一种图案。
所述颜色填充子模块11046,用于按照以下任一种填充方式填充所述响应图像;所述填充方式包括:由浅到深填充,由深到浅填充,冷、暖色填充。
所述绘制模块,还包括:
透明度设置子模块11048,用于设置所述响应图像的透明度。
以基于音量调整距离调整参数为例,当依据系统检测确定用户输入语音数据的音量时,若音量很小,可以调整m趋近于0,形状近似正圆;若音量很大,可以调整m趋近于r*0.5,形状根据m发生一定程度形变。此外除了利用m产生的形变对于音量反馈,还可以加上r、v对于音量的反馈,音量小的情况,r、v较小,音量大,r、v较大。其中,形变与大小共同作用的结果。
本实施例中,还可以配置多组基准点,从而绘制由多条闭合的赛贝尔曲线构成的响应图像,其中,为了让视觉效果更加丰富,每组基准点依据输入参数对应确定的调整参数可以不同,即每层的r,m,a,b,av,bv的值都可以不同,从而生成多层多变的响应图像。
上述论述了基于用户输入的语音数据确定调整参数,从而在每帧绘制不同的赛贝尔曲线进行响应的步骤。而在语音辅助控件在默认状态和读取状态时,可以按照默认的方式确定调整参数,或者与上述输入语音数据类似的方式确定调整参数,从而依据调整参数在每帧绘制不同的赛贝尔曲线进行响应,绘制步骤与上述类似,因此不再赘述。
上述实施例以语音输入为例,论述了基于用户输入绘制并显示响应图像的步骤。实际处理中,可以依据各种不同用户输入的特征,确定不同的调整参数进行响应图像中曲线的调整。
例如,对于触摸输入,可以基于触摸对应接触面积调整角速度调整参数、距离调整参数以及半径等调整参数,如确定单点触摸或多点触摸,每个触摸点的接触面积等,每触摸一次,显示相应的响应图像。又如对于键盘输入,可以各调整参数可以逐渐递增,从而每接收一次键盘输入,响应图像都在默认基础上跳变等。
在显示界面中显示动态变化的响应图像,即响应图像会持续变化,区别与闪现等时间较短的提示方式,能够给用户更加明确的提示,防止消息被忽略,能够及时进行提示。且响应图像动态变化,给用户以富有生命力的感受,提高用户体验。
本实施例中,使用会发生形变的圆形作为用户输入的响应图像,以对用户输入进行响应。上述步骤可以通用于多数针对CPU编程的计算机语言,还可以移植到针对GPU编程的计算机语言。
实施例四
在上述实施例的基础上,本实施例还公开了一种智能终端。
参照图12,示出了本申请一种智能终端实施例的结构框图,具体可以包括如下模块:
该智能终端1200包括:存储器1212、显示器1220、处理器1230和输入单元1240。
其中,该输入单元1240可用于接收用户输入的数字或字符信息,以及控制信号。具体地,本发明实施例中,该输入单元1240可以包括触摸屏1241,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触摸屏1241上的操作),并根据预先设定的程式驱动相应的连接装置。当然,除了触摸屏1241,输入单元1240还可以包括其他输入设备,如物理键盘、功能键(比如音量控制按键、开关按键等)、鼠标等。
显示器1220包括显示面板,可选的,可以采用液晶显示器(Liquid Crystal Display,LCD)或有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板。其中,触摸屏可以覆盖显示面板,形成触摸显示屏,当该触摸显示屏检测到在其上或附近的触摸操作后,传送给处理器1230以执行相应的处理。
在本发明实施例中,通过调用存储该存储器1212内的软件程序,和/或,模块,和/或,数据,处理器1230用于在显示界面内接收用户输入或获取提示消息;依据所述用户输或提示消息入绘制响应图像;将所述响应图像添加到所述显示界面中进行显示。
可选的,所述用户输入包括:语音输入、触摸输入和键盘输入。
可选的,所述响应图像为动态变化的图像;所述响应图像的变化频率与所述用户输入对应输入信息相关,和/或,所述响应图像的变化幅度与所述用户输入对应输入信息相关;其中,所述输入信息包括音量、输入速度、输入数量和/或时长。
可选的,所述变化频率与所述输入信息的变化数据成正比;所述变化幅度与所述输入信息的变化数据成正比。
可选的,所述响应图像由一条或多条闭合曲线构成。
可选的,所述闭合曲线随用户输入调整。
可选的,所述闭合曲线的半径与所述用户输入对应输入信息相关,其中,所述输入信息包括音量、输入速度、输入数量和/或时长。
可选的,所述闭合曲线的运动速度与所述用户输入对应输入信息相关,其中,所述输入信息包括音量、输入速度、输入数量和/或时长。
可选的,还包括:启动语音辅助控件时,在语音辅助控件对应显示界面内显示响应图像,其中,所述响应图像包括按照预置方式动态调整的闭合曲线。
可选的,所述用户输入包括语音输入,在显示界面内接收用户输入,包括:通过对所述语音辅助控件对应显示界面内的触发接收语音数据,将所述语音数据作为语音输入。
可选的,依据所述用户输入或接收提示消息绘制响应图像,包括:依据所述提示消息或语音输入对应语音数据确定圆心和半径;依据所述圆心和半径绘制圆形曲线,采用所述圆形曲线生成响应图像。
可选的,依据所述语音输入或接收提示消息绘制响应图像,包括:获取预置的圆心和半径对应圆周上的至少一组基准点;依据所述提示消息或语音输入对应语音数据调整各组基准点;依据至少一组基准点绘制闭合曲线,采用所述闭合曲线生成响应图像。
可选的,依据所述提示消息或语音输入对应语音数据调整各组基准点,包括:针对每一组基准点,依据所述提示消息或语音输入对应语音数据确定调整参数,采用正弦曲线和所述调整参数调整所述基准点的坐标信息。
可选的,依据所述提示消息或语音输入对应语音数据确定调整参数,采用正弦曲线和所述调整参数调整所述基准点,包括:依据所述提示消息或语音数据确定角速度调整参数和/或距离调整参数;依据角速度调整参数和/或距离调整参数对所述正弦曲线进行调整;依据调整的正弦曲线确定所述基准点的坐标信息。
可选的,依据至少一组基准点绘制闭合曲线,采用所述闭合曲线生成响应图像,包括:依据一组基准点中至少四个基准点的坐标信息绘制闭合的赛贝尔曲线;采用所述闭合的赛贝尔曲线构成响应图像。
可选的,依据至少一组基准点绘制闭合曲线,采用所述闭合曲线生成响应图像,包括:采用至少两组基准点的坐标信息分别绘制闭合的赛贝尔曲线,其中,每组基准点包括四个基准点;采用至少两条闭合的赛贝尔曲线构成响应图像。
可选的,还包括:播放语音辅助控件对应辅助语音数据时,依据所述辅助语音数据绘制响应图像,显示所述响应图像。
可选的,还包括:在所述响应图像中添加至少一种颜色或至少一种图案。
可选的,还包括:按照以下任一种填充方式填充所述响应图像;所述填充方式包括:由浅到深填充,由深到浅填充,冷、暖色填充。
可选的,还包括:设置所述响应图像的透明度。
对于装置实施例而言,由于其与方法实施例基本相似,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。
本说明书中的各个实施例均采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似的部分互相参见即可。
本领域内的技术人员应明白,本申请实施例的实施例可提供为方法、装置、或计算机程序产品。因此,本申请实施例可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请实施例可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
在一个典型的配置中,所述计算机设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。内存可能包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)和/或非易失性内存等形式,如只读存储器(ROM)或闪存(flash RAM)。内存是计算机可读介质的示例。计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。按照本文中的界定,计算机可读介质不包括非持续性的电脑可读媒体(transitory media),如调制的数据信号和载波。
本申请实施例是参照根据本申请实施例的方法、终端设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理终端设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理终端设 备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理终端设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理终端设备上,使得在计算机或其他可编程终端设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程终端设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
尽管已描述了本申请实施例的优选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例做出另外的变更和修改。所以,所附权利要求意欲解释为包括优选实施例以及落入本申请实施例范围的所有变更和修改。
最后,还需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者终端设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者终端设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者终端设备中还存在另外的相同要素。
以上对本申请所提供的一种输入操作的处理方法、一种输入操作的处理装置,以及一种智能终端,进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。

Claims (41)

  1. 一种输入操作的处理方法,其特征在于,包括:
    在显示界面内接收用户输入或获取提示消息;
    依据所述用户输入或提示消息绘制响应图像;
    将所述响应图像添加到所述显示界面中进行显示。
  2. 根据权利要求1所述的方法,其特征在于,所述用户输入包括:语音输入、触摸输入和键盘输入。
  3. 根据权利要求1所述的方法,其特征在于,所述响应图像为动态变化的图像;
    所述响应图像的变化频率与所述用户输入对应输入信息相关,和/或,所述响应图像的变化幅度与所述用户输入对应输入信息相关;
    其中,所述输入信息包括音量、输入速度、输入数量和/或时长。
  4. 根据权利要求3所述的方法,其特征在于,所述变化频率与所述输入信息的变化数据成正比;
    所述变化幅度与所述输入信息的变化数据成正比。
  5. 根据权利要求2所述的方法,其特征在于,所述响应图像由一条或多条闭合曲线构成。
  6. 根据权利要求5所述的方法,其特征在于,所述闭合曲线随用户输入调整。
  7. 根据权利要求6所述的方法,其特征在于,所述闭合曲线的半径与所述用户输入对应输入信息相关,其中,所述输入信息包括音量、输入速度、输入数量和/或时长。
  8. 根据权利要求6所述的方法,其特征在于,所述闭合曲线的运动速度与所述用户输入对应输入信息相关,其中,所述输入信息包括音量、输入速度、输入数量和/或时长。
  9. 根据权利要求1所述的方法,其特征在于,还包括:
    启动语音辅助控件时,在语音辅助控件对应显示界面内显示响应图像,其中,所述响应图像包括按照预置方式动态调整的闭合曲线。
  10. 根据权利要求9所述的方法,其特征在于,所述用户输入包括语音输入,在显示界面内接收用户输入,包括:
    通过对所述语音辅助控件对应显示界面内的触发接收语音数据,将所述语音数据作为语音输入。
  11. 根据权利要求10所述的方法,其特征在于,依据所述用户输入或接收提示消 息绘制响应图像,包括:
    依据所述提示消息或所述语音输入对应语音数据确定圆心和半径;
    依据所述圆心和半径绘制圆形曲线,采用所述圆形曲线生成响应图像。
  12. 根据权利要求10所述的方法,其特征在于,依据所述语音输入或接收提示消息绘制响应图像,包括:
    获取预置的圆心和半径对应圆周上的至少一组基准点;
    依据所述提示消息或所述语音输入对应语音数据调整各组基准点;
    依据至少一组基准点绘制闭合曲线,采用所述闭合曲线生成响应图像。
  13. 根据权利要求12所述的方法,其特征在于,依据所述提示消息或语音输入对应语音数据调整各组基准点,包括:
    针对每一组基准点,依据所述提示消息或语音输入对应语音数据确定调整参数,采用正弦曲线和所述调整参数调整所述基准点的坐标信息。
  14. 根据权利要求13所述的方法,其特征在于,依据所述提示消息或语音输入对应语音数据确定调整参数,采用正弦曲线和所述调整参数调整所述基准点,包括:
    依据所述提示消息或语音数据,确定角速度调整参数和/或距离调整参数;
    依据角速度调整参数和/或距离调整参数对所述正弦曲线进行调整;
    依据调整的正弦曲线确定所述基准点的坐标信息。
  15. 根据权利要求12所述的方法,其特征在于,依据至少一组基准点绘制闭合曲线,采用所述闭合曲线生成响应图像,包括:
    依据一组基准点中至少四个基准点的坐标信息绘制闭合的赛贝尔曲线;
    采用所述闭合的赛贝尔曲线构成响应图像。
  16. 根据权利要求12所述的方法,其特征在于,依据至少一组基准点绘制闭合曲线,采用所述闭合曲线生成响应图像,包括:
    采用至少两组基准点的坐标信息分别绘制闭合的赛贝尔曲线,其中,每组基准点包括四个基准点;
    采用至少两条闭合的赛贝尔曲线构成响应图像。
  17. 根据权利要求9所述的方法,其特征在于,还包括:
    播放语音辅助控件对应辅助语音数据时,依据所述辅助语音数据绘制响应图像,显示所述响应图像。
  18. 根据权利要求17所述的方法,其特征在于,还包括:
    在所述响应图像中添加至少一种颜色或至少一种图案。
  19. 根据权利要求17所述的方法,其特征在于,还包括:
    按照以下任一种填充方式填充所述响应图像;
    所述填充方式包括:由浅到深填充,由深到浅填充,冷、暖色填充。
  20. 根据权利要求17所述的方法,其特征在于,还包括:
    设置所述响应图像的透明度。
  21. 一种输入操作的处理装置,其特征在于,包括:
    输入接收模块,用于在显示界面内接收用户输入或获取提示消息;
    绘制模块,用于依据所述用户输入或提示消息绘制响应图像;
    显示模块,用于将所述响应图像添加到所述显示界面中进行显示。
  22. 根据权利要求21所述的装置,其特征在于,
    所述用户输入包括:语音输入、触摸输入和键盘输入。
  23. 根据权利要求21所述的装置,其特征在于,所述响应图像为动态变化的图像;
    所述响应图像的变化频率与所述用户输入对应输入信息相关,和/或,所述响应图像的变化幅度与所述用户输入对应输入信息相关;
    其中,所述输入信息包括音量、输入速度、输入数量和/或时长。
  24. 根据权利要求23所述的装置,其特征在于,所述变化频率与所述输入信息的变化信息成正比;
    所述变化幅度与所述输入信息的变化信息成正比。
  25. 根据权利要求22所述的装置,其特征在于,所述响应图像由一条或多条闭合曲线构成。
  26. 根据权利要求25所述的装置,其特征在于,所述闭合曲线随用户输入调整。
  27. 根据权利要求26所述的装置,其特征在于,所述闭合曲线的半径与所述用户输入对应输入信息相关,其中,所述输入信息包括音量、输入速度、输入数量和/或时长。
  28. 根据权利要求26所述的装置,其特征在于,所述闭合曲线的运动速度与所述用户输入对应输入信息相关,其中,所述输入信息包括音量、输入速度、输入数量和/或时长。
  29. 根据权利要求21所述的装置,其特征在于,
    所述显示模块,还用于启动语音辅助控件时,在语音辅助控件对应显示界面内显示响应图像,其中,所述响应图像包括按照预置方式动态调整的闭合曲线。
  30. 根据权利要求29所述的装置,其特征在于,所述用户输入包括语音输入,
    所述输入接收模块,用于通过对所述语音辅助控件对应显示界面内的触发接收语音数据,将所述语音数据作为语音输入。
  31. 根据权利要求30所述的装置,其特征在于,所述绘制模块,包括:
    第一绘制子模块,用于依据所述提示消息或所述语音输入对应语音数据确定圆心和半径;依据所述圆心和半径绘制圆形曲线,采用所述圆形曲线生成响应图像。
  32. 根据权利要求31所述的装置,其特征在于,所述绘制模块,包括:
    第二绘制子模块,用于获取预置的圆心和半径对应圆周上的至少一组基准点;依据所述提示消息或语音输入对应语音数据调整各组基准点;依据至少一组基准点绘制闭合曲线,采用所述闭合曲线生成响应图像。
  33. 根据权利要求31所述的装置,其特征在于,第二绘制子模块,包括:
    参数调整单元,用于针对每一组基准点,依据提示消息或语音输入对应语音数据确定调整参数,采用正弦曲线和所述调整参数调整所述基准点的坐标信息。
  34. 根据权利要求33所述的装置,其特征在于,
    所述参数调整单元,用于依据所述提示消息或语音数据,确定角速度调整参数和/或距离调整参数;依据角速度调整参数和/或距离调整参数对所述正弦曲线进行调整;依据调整的正弦曲线确定所述基准点的坐标信息。
  35. 根据权利要求32所述的装置,其特征在于,第二绘制子模块,包括:
    绘制生成单元,用于依据一组基准点中至少四个基准点的坐标信息绘制闭合的赛贝尔曲线;采用所述闭合的赛贝尔曲线构成响应图像。
  36. 根据权利要求32所述的装置,其特征在于,第二绘制子模块,包括:
    绘制生成单元,用于采用至少两组基准点的坐标信息分别绘制闭合的赛贝尔曲线,其中,每组基准点包括四个基准点;采用至少两条闭合的赛贝尔曲线构成响应图像。
  37. 根据权利要求29所述的装置,其特征在于,
    所述绘制模块,还用于播放语音辅助控件对应辅助语音数据时,依据所述辅助语音数据绘制响应图像。
  38. 根据权利要求37所述的装置,其特征在于,所述绘制模块,还包括:
    颜色填充子模块,用于在所述响应图像中添加至少一种颜色或至少一种图案。
  39. 根据权利要求37所述的装置,其特征在于,所述绘制模块,还包括:
    颜色填充子模块,用于按照以下任一种填充方式填充所述响应图像;所述填充方式 包括:由浅到深填充,由深到浅填充,冷、暖色填充。
  40. 根据权利要求37所述的装置,其特征在于,所述绘制模块,还包括:
    透明度设置子模块,用于设置所述响应图像的透明度。
  41. 一种智能终端,其特征在于,包括:所述智能终端包括:存储器、显示器、处理器和输入单元,其中,所述输入单元包括:触摸屏;
    所述处理器用于执行上述权利要求1-20任一所述的方法。
PCT/CN2016/107596 2015-12-09 2016-11-29 输入操作的处理方法、装置和智能终端 Ceased WO2017097141A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510907810.XA CN106855780A (zh) 2015-12-09 2015-12-09 输入操作的处理方法、装置和智能终端
CN201510907810.X 2015-12-09

Publications (1)

Publication Number Publication Date
WO2017097141A1 true WO2017097141A1 (zh) 2017-06-15

Family

ID=59012700

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/107596 Ceased WO2017097141A1 (zh) 2015-12-09 2016-11-29 输入操作的处理方法、装置和智能终端

Country Status (2)

Country Link
CN (1) CN106855780A (zh)
WO (1) WO2017097141A1 (zh)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101873366A (zh) * 2010-06-12 2010-10-27 宇龙计算机通信科技(深圳)有限公司 一种根据输入信息改变键盘显示的方法及装置
CN102460346A (zh) * 2009-06-10 2012-05-16 微软公司 触摸任何地方来讲话
CN103197911A (zh) * 2013-04-12 2013-07-10 广东国笔科技股份有限公司 一种提供语音输入的方法、系统和装置
US20140379341A1 (en) * 2013-06-20 2014-12-25 Samsung Electronics Co., Ltd. Mobile terminal and method for detecting a gesture to control functions

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4456675B2 (ja) * 1996-04-17 2010-04-28 株式会社日立製作所 映像記録再生装置及び映像記録再生方法
CN100512030C (zh) * 2001-03-29 2009-07-08 哈茉尼彩色音技术开发公司 将声音转换为图像并在屏幕上显示的电话和方法
KR20050020523A (ko) * 2003-08-23 2005-03-04 엘지전자 주식회사 휴대단말기의 착신벨 박자 연동 애니메이션 출력장치 및방법
KR20080048837A (ko) * 2006-11-29 2008-06-03 삼성전자주식회사 촉각 피드백을 출력하는 장치 및 방법
CN102385473A (zh) * 2010-09-02 2012-03-21 腾讯科技(深圳)有限公司 页面切换方法和装置
CN103731707A (zh) * 2013-12-03 2014-04-16 乐视致新电子科技(天津)有限公司 移动终端设备控制智能电视端语音输入的方法及系统

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102460346A (zh) * 2009-06-10 2012-05-16 微软公司 触摸任何地方来讲话
CN101873366A (zh) * 2010-06-12 2010-10-27 宇龙计算机通信科技(深圳)有限公司 一种根据输入信息改变键盘显示的方法及装置
CN103197911A (zh) * 2013-04-12 2013-07-10 广东国笔科技股份有限公司 一种提供语音输入的方法、系统和装置
US20140379341A1 (en) * 2013-06-20 2014-12-25 Samsung Electronics Co., Ltd. Mobile terminal and method for detecting a gesture to control functions

Also Published As

Publication number Publication date
CN106855780A (zh) 2017-06-16

Similar Documents

Publication Publication Date Title
JP7781225B2 (ja) 触覚フィードバックを提供するデバイス、方法、及びグラフィカルユーザインタフェース
US11321041B2 (en) Systems, devices, and methods for dynamically providing user interface controls at a touch-sensitive secondary display
US20220187961A1 (en) Devices, Methods, and Graphical User Interfaces for Moving a Current Focus Using a Touch-Sensitive Remote Control
US11429145B2 (en) Systems and methods for prompting a log-in to an electronic device based on biometric information received from a user
US11488406B2 (en) Text detection using global geometry estimators
US20240184513A1 (en) Systems, Methods, and Graphical User Interfaces for Selecting Audio Output Modes of Wearable Audio Output Devices
US8302027B2 (en) Graphic user interface management system and method
US20220342443A1 (en) Systems and Methods for Prompting a Log-In to an Electronic Device Based on Biometric Information Received from a User
KR20140063500A (ko) 오프-스크린 가시 객체들의 표면화
CN110727369A (zh) 电子装置
US12093524B2 (en) Multifunction device control of another electronic device
JP2025510489A (ja) ページ対話のための方法、装置、デバイス、及び記憶媒体
US20140115510A1 (en) Information Processing Method And Electronic Device
WO2017097142A1 (zh) 界面操作的处理方法、装置和智能终端
US10956004B2 (en) Recognizing user interface element selection
WO2017097141A1 (zh) 输入操作的处理方法、装置和智能终端
TW201828026A (zh) 輸入操作的處理方法、裝置和智慧終端
TWI724096B (zh) 介面操作的處理方法、裝置和智慧終端

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16872332

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16872332

Country of ref document: EP

Kind code of ref document: A1