CN114690992A - Prompting method and device and computer storage medium - Google Patents

Prompting method and device and computer storage medium Download PDF

Info

Publication number
CN114690992A
CN114690992A CN202110117883.4A CN202110117883A CN114690992A CN 114690992 A CN114690992 A CN 114690992A CN 202110117883 A CN202110117883 A CN 202110117883A CN 114690992 A CN114690992 A CN 114690992A
Authority
CN
China
Prior art keywords
prompt
preset
operation object
information
touch
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110117883.4A
Other languages
Chinese (zh)
Other versions
CN114690992B (en
Inventor
时红仁
姜顺豹
高健
王鹏
孙中全
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Qwik Smart Technology Co Ltd
Original Assignee
Shanghai Qwik Smart Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Qwik Smart Technology Co Ltd filed Critical Shanghai Qwik Smart Technology Co Ltd
Priority to CN202310756068.1A priority Critical patent/CN116680033A/en
Publication of CN114690992A publication Critical patent/CN114690992A/en
Application granted granted Critical
Publication of CN114690992B publication Critical patent/CN114690992B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G06F9/453—Help systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Library & Information Science (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The application discloses a prompting method, a prompting device and a computer storage medium, wherein the prompting method comprises the following steps: acquiring input operation information, wherein the operation information comprises at least one of touch operation information, voice operation information and shooting image information of a first operation object; identifying the first operation object based on the operation information; and presenting a first operation prompt related to the first operation object under the condition that the operation information meets a preset condition. According to the prompting method, the prompting device and the computer storage medium, when the input operation information is determined to meet the preset condition, the prompting message for operating the operation object is automatically presented, so that the user can quickly obtain the operation instruction for the operation object, the operation is simple and convenient, and the user experience is improved.

Description

Prompting method and device and computer storage medium
Technical Field
The present invention relates to the field of information processing technologies, and in particular, to a method and an apparatus for prompting and a computer storage medium.
Background
With the rapid development of terminal technology, the functions of the vehicle-mounted system are more and more diversified, and meanwhile, the function controls configured by the vehicle-mounted system are more and more corresponding. In a scene of using the vehicle-mounted system, when a user is confused about the use of the vehicle-mounted system or cannot obtain a response to the use of the vehicle-mounted system, the user often searches or searches for a help document of the vehicle-mounted system through networking and other methods for inquiring, but the method is not only complicated in operation, but also often difficult to find needed help, and seriously affects the use experience of the user.
The foregoing description is provided for general background information and is not admitted to be prior art.
Disclosure of Invention
An object of the present invention is to provide a prompting method, apparatus and computer storage medium, which are advantageous in that when it is determined that a user wishes to obtain a help prompt for an operation object according to input operation information, a prompt message for operating the operation object is automatically presented, so that the user can quickly obtain an operation instruction for the operation object, the operation is simple and convenient, and the user experience is improved.
It is another object of the present invention to provide a presentation method, an electronic device, and a computer storage medium, which are advantageous in that operation information can be input in a variety of different ways.
Another object of the present invention is to provide a prompting method, an electronic device, and a computer storage medium, which are advantageous in that operation prompts for an operation object can be presented in different ways.
Another object of the present invention is to provide a prompting method, an electronic device, and a computer storage medium, which are advantageous in that a corresponding operation prompt can be presented even if an operation object is not activated or used for a long time.
Additional advantages and features of the invention will be set forth in the detailed description which follows and in part will be apparent from the description, or may be learned by practice of the invention as set forth hereinafter.
According to one aspect of the present invention, the foregoing and other objects and advantages are achieved by a presentation method of the present invention, comprising the steps of:
acquiring input operation information, wherein the operation information comprises at least one of touch operation information, voice operation information and shooting image information of a first operation object;
identifying the first operation object based on the operation information; and
and presenting a first operation prompt related to the first operation object under the condition that the operation information meets a preset condition.
According to an embodiment of the present invention, the presenting the first operation prompt related to the first operation object includes at least one of the following ways:
displaying a document or a character containing a first operation prompt related to the first operation object;
displaying a small video or page containing a first operation prompt related to the first operation object;
displaying a hanging window containing a help key, wherein the help key is used for triggering and displaying a first operation prompt related to the first operation object; and
and broadcasting voice containing a first operation prompt related to the first operation object.
According to an embodiment of the invention, further comprising the steps of:
and displaying a second operation prompt related to a second operation object under the condition that the second operation object meeting the prompt condition exists in the current operation interface.
Accordingly, the present invention provides a prompting device for executing the above method, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the following steps: acquiring input operation information, wherein the operation information comprises at least one of touch operation information, voice operation information and shooting image information of a first operation object; identifying the first operation object based on the operation information; and presenting a first operation prompt related to the first operation object under the condition that the operation information meets a preset condition.
Accordingly, the present invention provides a computer storage medium storing a computer program, which when executed by a processor implements the steps of the above-described prompting method.
Drawings
Fig. 1 is a schematic flow chart of a prompting method according to an embodiment of the present invention;
FIG. 2 is a schematic view of a first application scenario of the prompt method in the embodiment of the present invention;
FIG. 3 is a schematic diagram of an application scenario of the prompting method in the embodiment of the present invention;
FIG. 4 is a schematic diagram of an application scenario of the prompting method in the embodiment of the present invention;
FIG. 5 is a diagram illustrating a fourth application scenario of the prompting method according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of an application scenario of the prompt method in the embodiment of the present invention;
fig. 7 is a schematic diagram six of an application scenario of the prompting method in the embodiment of the present invention;
fig. 8 is a schematic structural diagram of a prompting device according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the recitation of an element by the phrase "comprising an … …" does not exclude the presence of additional like elements in the process, method, article, or apparatus that comprises the element, and further, where similarly-named elements, features, or elements in different embodiments of the disclosure may have the same meaning, or may have different meanings, that particular meaning should be determined by their interpretation in the embodiment or further by context with the embodiment.
It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope herein. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context. Also, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used in this specification, specify the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not preclude the presence, or addition of one or more other features, steps, operations, elements, components, species, and/or groups thereof. The terms "or" and/or "as used herein are to be construed as inclusive or meaning any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: a; b; c; a and B; a and C; b and C; A. b and C ". An exception to this definition will occur only when a combination of elements, functions, steps or operations are inherently mutually exclusive in some way.
It should be understood that, although the steps in the flowcharts in the embodiments of the present application are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, in different orders, and may be performed alternately or at least partially with respect to other steps or sub-steps of other steps.
It should be noted that step numbers such as S101 and S102 are used herein for the purpose of more clearly and briefly describing the corresponding contents, and do not constitute a substantial limitation on the sequence, and those skilled in the art may perform S102 first and then S101 in specific implementations, but these steps should be within the scope of the present application.
It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for the convenience of description of the present application, and have no specific meaning in themselves. Thus, "module", "component" or "unit" may be used mixedly.
Referring to fig. 1, a schematic flow chart of a prompting method according to an embodiment of the present invention is shown, where the prompting method is applicable to a situation of operation help prompting, and the prompting method may be executed by a prompting device according to an embodiment of the present invention, where the prompting device may be implemented in a software and/or hardware manner, and the prompting device may specifically be a vehicle-mounted terminal such as a car machine, and in this embodiment, the prompting method is described by taking an example where the prompting method is applied to a car machine, and includes the following steps:
step S101: acquiring input operation information, wherein the operation information comprises at least one of touch operation information, voice operation information and shooting image information of a first operation object;
the operation object may be a control such as a button, an icon, a check box, a drop-down list and the like displayed on an operation interface of the vehicle machine, or may be each switch button, an indicator table, an indicator light and the like inside the vehicle. The car machine CAN acquire touch operation information of the first operation object through a CAN bus and the like, acquire voice operation information of the first operation object through voice acquisition equipment such as a microphone, and acquire shot image information of the first operation object through communication connection established with external equipment such as a smart phone and the like. It can be understood that the obtaining of the input touch operation information may be that the touch operation information is obtained based on an input device such as a touch screen of a vehicle machine, and the corresponding touch operation may be operations such as clicking, pressing, and touching of different fingers of a user on the touch screen, for example, when the user clicks on the touch screen with a finger, the touch operation may be an operation of finger clicking; when a user presses a finger on the touch screen, the touch operation may be a finger pressing operation. Optionally, the touch operation information may include a touch duration of the touch operation and/or a touch frequency of the touch operation, and taking the first operation object as a virtual key as an example, if the user continuously presses the virtual key with a finger, a duration of the continuous pressing is the touch duration of the touch operation; and if the user clicks the virtual key by using a finger, the number of clicks on the virtual key within a preset time length is the number of touch operations. In addition, the touch operation information may also include a touch trajectory and/or a touch pattern and/or a type of touch operation, such as a single click, a double click, a multi-click, and the like divided according to the click type.
Here, before the acquiring the input operation information, the method may further include: and starting a prompt mode, and executing the step of acquiring the input operation information. It should be noted that the car machine may be provided with a user interface for controlling whether to start the prompt mode, and the user interface may be provided with an open key, a close key, or an integrated control key, or may be provided with a voice recognition module. Specifically, when the user interface is only provided with an open key and a close key, and when a user touches the open key, the prompt mode is started, which is equivalent to the fact that the vehicle machine receives a prompt mode starting instruction; when the user touches the close key, the prompt mode is closed when the vehicle machine receives a prompt mode close instruction. When the user interface is only provided with the voice recognition module, the voice recognition module recognizes the voice signal of the user to recognize whether a prompt mode starting instruction exists in the voice signal of the user, so that the prompt mode is started when the voice instruction of the prompt mode starting instruction is received, and further the operation information input by the user is acquired. Here, the car machine may also have a switch for turning on or off the prompt mode.
Step S102: identifying the first operation object based on the operation information;
it should be noted that, for the touch operation information, the car machine may directly determine the first operation object according to the touch operation information, that is, the car machine may directly determine the touch object corresponding to the touch operation information as the first operation object. For example, a certain control (e.g., a voice input control) or a certain area (e.g., a video display area) corresponding to a touch point in the touch operation information may be determined as the first operation object. For the voice operation information and the captured image information, the car machine may need further recognition to acquire the first operation object. In one embodiment, the identifying the first operation object based on the operation information includes at least one of the following ways: intercepting a target image in the shot image information, matching the target image with a preset image in a first database to determine a preset image with the highest matching degree, and determining a preset operation object associated with the preset image as the first operation object based on the preset image; the first database stores different preset operation objects and associated preset images; identifying a target keyword in the shot image information, matching the target keyword with a first preset keyword in a second database to determine a first preset keyword with the highest matching degree, and determining a preset operation object associated with the first preset keyword as the first operation object based on the first preset keyword; the second database stores different preset operation objects and associated first preset keywords. The first preset keyword is used for indicating the name or the function of the first operation object. It can be understood that, if the captured image information includes an image or a keyword of an operation object, the image or the keyword may be acquired first, and then the first operation object may be determined according to the operation object associated with the image or the keyword. For example, suppose that a user uses a smart phone to photograph an air conditioner temperature button, and transmits obtained photographed image information to a vehicle machine, and the vehicle machine obtains an image of the air conditioner temperature button by matching in a first database based on the photographed image information, thereby determining that a first operation object is the air conditioner temperature button. Furthermore, suppose that a user uses a smart phone to photograph a button displayed with a "+" sign, and transmits the obtained photographed image information to the in-vehicle machine, the in-vehicle machine obtains a first preset keyword "rise" by matching in a second database based on the photographed image information, and then determines that the first operation object is the volume. Therefore, the first operation object is determined based on the image or the keyword in the shot image information, the operation is convenient and fast, and the accuracy is high.
In addition, if there are a plurality of items of acquired operation information, a certain item of operation information can be preferentially identified to obtain the first operation object based on a preset priority level, without considering other operation information. For example, assuming that the car machine acquires the voice operation information immediately after acquiring the touch operation information, the touch operation object may be directly determined as the first operation object at this time, and it is not necessary to continue to acquire the first operation object according to the voice operation information. If there are a plurality of first operation objects identified based on the operation information, prompt information may be output to enable a user to select a first operation object that is actually needed, or a corresponding operation prompt may be presented for each first operation object.
Step S103: and presenting a first operation prompt related to the first operation object under the condition that the operation information meets a preset condition.
Here, the preset condition may be set according to actual requirements according to different operation information. In one embodiment, the preset condition comprises at least one of the following conditions: the touch duration of the touch operation meets a first duration preset condition; the touch frequency of the touch operation meets a frequency preset condition; the frequency of continuous recognition failure of the input voice operation information meets a frequency preset condition; and detecting that the input time interval between the touch operation information and the voice operation information is smaller than a preset time threshold, and recognizing that the voice operation information contains a second preset keyword. The touch duration of the touch operation meeting the first duration preset condition may be that the touch duration of the touch operation is greater than a preset duration threshold, for example, the touch duration is greater than 3 seconds, 5 seconds, or 8 seconds; the condition that the number of times of touch operation satisfies the number preset condition may be that the number of times of touch operation is greater than a preset number threshold, for example, the number of times of touch operation is greater than 2 or 3. It can be understood that, when the user does not know the voice control mode of a certain operation object, correct voice operation information may not be continuously input, thereby causing the vehicle to fail to continuously recognize the input voice operation information. If the number of times of continuous recognition failure of the input voice operation information detected by the car machine meets a number preset condition, for example, the number of times of continuous recognition failure of the voice operation information input by the user is greater than a preset number threshold, it may be considered that a help prompt for operating the operated object needs to be provided for the user. Here, when the car machine detects that the input time interval between the touch operation information and the voice operation information is smaller than a preset time threshold and recognizes that the voice operation information includes a second preset keyword, it indicates that the user needs to control a certain operation object to request help, and at this time, a help prompt for operating the operation object needs to be provided for the user. The second preset keyword may be a question word, a specific word, or the like, such as a word identifying "what" or "what" included in the voice operation information, or a word identifying "meaning", "use", "not", "help", or the like included in the voice operation information. So, detect operation information in order to judge whether need be presented about through the multiple different default condition that sets up first operation suggestion of first operation object, it is nimble and convenient, further promoted user and used experience.
Here, the operation prompt is used to prompt the user how to correctly operate the operation object, and taking the first operation object as the air conditioner as an example, the first operation prompt may be how to control the temperature, the air volume, and the like of the air conditioner by voice. It should be noted that, after the first operation prompt about the first operation object is presented, the car machine may further display an effect prompt after the first operation object is operated, where the effect prompt is used to prompt a user of a corresponding effect after a corresponding operation is performed on the first operation object, for example, if the first operation object is a switch key of a certain function, when the operation information is how to turn on the function, the effect prompt may be what effects the function corresponds to after being turned on, and if what other functions may be turned off, etc.
In one embodiment, the presenting a first operation prompt regarding the first operation object includes: identifying at least one function keyword related to the first operation object in the voice operation information; retrieving a preset third database based on the at least one functional keyword, and acquiring and presenting a first operation prompt related to the first operation object; and the third database stores at least one function keyword and associated first operation prompts of different first operation objects. It should be noted that, when the car machine only obtains the input voice operation information, that is, when the user controls the operation object through voice, the car machine may first perform voice recognition on the voice operation information to recognize at least one function keyword related to the first operation object in the voice operation information; and then, the vehicle machine searches at least one function keyword and associated first operation prompt of different first operation objects stored in a third database, and acquires and presents the first operation prompt related to the first operation object. For example, assuming that the voice operation information is "how to adjust the angle of the rear view mirror", the car machine recognizes that the first operation object is the rear view mirror, and the at least one function keyword related to the first operation object includes "angle" and "adjustment" based on the voice operation information, and then matches the first operation keyword in the third database to obtain a corresponding first operation prompt of "turn the inside knob of the car door left or right". Therefore, by identifying the function keywords related to the operation object contained in the voice and further acquiring the operation prompt related to the operation object based on the function keywords, the operation is convenient and fast, and the accuracy is high.
It is to be understood that, according to a requirement, the third database may need to be updated at any time, for example, the function keyword and/or the first operation prompt associated with the first operation object are updated, and the like. In one embodiment, the third database may be updated based on the following steps: acquiring an update instruction for updating the third database, wherein the update instruction comprises an update configuration node and an update configuration file, the update configuration node is used for indicating one of a first operation object, a function keyword and a first operation prompt to be updated, and the update configuration file comprises at least one of the first operation object, the function keyword and the first operation prompt to be updated, which are associated with the update configuration node; and replacing or adding the update configuration file at an update configuration node based on the update instruction so as to replace or add at least one of the first operation object, the function keyword and the first operation prompt to be updated in the third database. For example, assuming that only two functional keywords of low and high are stored in the third database for the operation object of the air conditioner temperature, and the two keywords of hot air and cold air need to be updated into the third database at present, after the vehicle machine obtains an update instruction including an addition configuration node and an addition configuration file, the configuration node is two keywords of hot air and cold air, and the configuration file is a file in json format, and by adding the configuration file to the configuration node, the voice prompt for automatically increasing skills corresponding to the two keywords of cold air and hot air can be realized. Therefore, the operation object, the function keywords, the operation prompt and the like can be updated quickly and conveniently, and the user experience is further improved.
In one embodiment, the presenting the first operation prompt regarding the first operation object includes at least one of:
determining a display position and/or a display area size of the first operation prompt based on an input adjustment instruction or a change of an operation interface so as to present the first operation prompt about the first operation object;
determining a background transparency of the first operation prompt so that the first operation prompt about the first operation object is presented; and
presenting, at an electronic device, the first operation prompt regarding the first operation object.
It should be noted that, after the first operation prompt related to the first operation object is presented, if the first operation prompt related to the first operation object is displayed, at this time, the user may manually input an adjustment instruction (for example, drag, stretch, shrink, or the like) to adjust a display position and/or a display area size of the first operation prompt, so that the first operation prompt is displayed at the determined display position and/or display area of the first operation prompt. Of course, if the operation interface is changed, the display position and/or the size of the display area of the first operation prompt may be changed accordingly, for example, the display position of the first operation prompt is always in the blank area of the operation interface, or when the area of the blank area of the current operation interface after the change is smaller than the area of the blank area of the previous operation interface, the display area of the first operation prompt may be reduced accordingly. In practical application, for different operation interfaces, the display position of the first operation prompt may be preset, and when the operation interface is switched, the first operation prompt is displayed at the corresponding preset position. For example, if the current operation interface is a multimedia playing interface, the first operation prompt may be displayed at a lower left corner of the operation interface, and if the user switches the current operation interface from the multimedia playing interface to the main interface, the first operation prompt may be displayed at a lower right corner of the operation interface. In addition, when the operation interface is switched, the first operation prompt can be always displayed in a blank area of the operation interface. The blank area of the operation interface can be acquired in the following way: one mode is that firstly, a screen is captured on an operation interface, then, an optical character recognition technology is used for recognizing which areas in the operation interface have characters, an image recognition technology is used for recognizing which areas in the operation interface have images, and then, the areas without the characters and the images in the operation interface are determined as blank areas; the other mode is that based on the control tree corresponding to the operation interface, a control used for displaying pictures and characters in the control tree and a display area of the control in the operation interface are obtained, then the control currently displaying the pictures and the characters is obtained from the control, and then the display area corresponding to the control not currently displaying the pictures and the characters in the operation interface is determined as a blank area.
In addition, the background transparency of the first operation prompt may also be set to be semi-transparent or fully transparent, so as to reduce the occlusion of the first operation prompt on the content displayed on the operation interface as much as possible. Alternatively, the car machine may also transmit the first operation prompt related to the first operation object to an electronic device (for example, but not limited to, a mobile phone, a tablet computer, a smart speaker, etc.), so that the electronic device presents the first operation prompt related to the first operation object. In practical applications, the first operation prompt related to the first operation object may also be displayed in a blank area, a corner area, or a preset area near the first operation object of the current operation interface. The blank area may refer to an area where objects such as characters and images are not displayed in the current operation interface, and the corner area may refer to an upper left corner area, a lower left corner area, an upper right corner area, a lower right corner area, a bottom area, a top area, or the like of the current operation interface or the touch screen. The preset region near the first operation object may be a left region, a right region, an upper region, a lower region, and the like of the first operation object, and the size of the preset region may be preset, or may be adaptively adjusted according to the first operation prompt. Therefore, the first operation prompt about the first operation object is presented in different modes, the prompt can be effectively performed on the user, meanwhile, the shielding of the operation interface can be avoided or reduced as much as possible, the prompt information can be continuously displayed when the user turns the page to operate, the operation interface is not shielded, the user can perform other operations conveniently, and the user use experience is further improved.
In one embodiment, the presenting the first operation prompt regarding the first operation object includes at least one of:
displaying a document or a character containing a first operation prompt related to the first operation object;
displaying a small video or page containing a first operation prompt related to the first operation object;
displaying a hung window containing a help key, wherein the help key is used for triggering and displaying a first operation prompt related to the first operation object; and
and broadcasting voice containing a first operation prompt related to the first operation object.
Here, the document, the text, the hanging window, the small video or the page, etc. may be displayed in a full screen or a half screen on the in-vehicle machine, for example, a page including the first operation prompt related to the first operation object is displayed in a full screen on the in-vehicle machine, or a page including the first operation prompt related to the first operation object is displayed in a left half of the in-vehicle machine, etc. The suspension window can be directly displayed above the first operation object or at other positions, and the suspension window can also comprise other keys such as a close key, an update key and the like. In addition, the suspended window may display the help prompt included therein when being triggered, so as to minimize the obstruction of the operation interface, for example, the suspended window may display the help prompt included therein as a circular button on the operation interface when not being triggered, and display the help prompt included therein after the user clicks the circular button. And after the user clicks the help key, the vehicle machine displays a first operation prompt related to the first operation object. Meanwhile, the car machine can broadcast voice containing a first operation prompt related to the first operation object through voice playing equipment such as a loudspeaker in the car. Therefore, the first operation prompt about the first operation object is presented in different modes, the prompt can be effectively carried out on the user, and the user use experience is further improved.
In an embodiment, the method may further comprise the steps of: and displaying a second operation prompt related to a second operation object under the condition that the second operation object meeting the prompt condition exists in the current operation interface. Here, the prompt condition may include at least one of that the second operation object is not activated, and that a length of time during which the second operation object is not used satisfies a second length preset condition. The non-activation of the second operation object may mean that the second operation object is not used, such as not clicked. The fact that the unused duration of the second operation object meets the second duration preset condition may mean that the unused duration of the second operation object is greater than a preset duration threshold, for example, the unused duration of the second operation object is greater than 10 days, 30 days, and the like. It can be understood that when a second operation object meeting the prompt condition exists in the current operation interface, a second operation prompt related to the second operation object is displayed to prompt the user to operate the second operation object, so that the user is familiar with different operation objects, knows the operation objects which are not used, and can effectively improve the viscosity of the user. For example, if there is a virtual key in the current operation interface, the function of the virtual key is to automatically adjust the brightness of the screen of the vehicle according to the brightness of the light in the vehicle, and if the user has not activated the virtual key, the intelligent voice assistant may prompt the user to use the automatic dimming function, such as "whether to try the automatic dimming function".
In an embodiment, the method may further comprise the steps of: and closing a first operation prompt related to the first operation object after detecting a preset closing prompt operation. Here, the operation of detecting the preset close prompt may be an operation of detecting that a touch operation is ended, detecting a short-press operation on the first operation prompt or the effect prompt, and detecting that a click is performed on an area other than the first operation prompt or the effect prompt in the current operation interface. Therefore, after the preset closing prompt operation is detected, the first operation prompt related to the first operation object is closed in time, so that a user can conveniently execute other operations, and the user experience is further improved.
In an embodiment, the first operation prompt includes a prompt message indicating whether manual assistance is required, and after the first operation prompt presented to the first operation object, the method may further include the following steps: in the event that it is determined that manual assistance is needed, transition is made to a manual service mode to obtain assistance. After the first operation prompt about the first operation object is presented, if the in-vehicle machine detects that the user selects to need manual assistance for the first operation prompt, switching to a manual service mode to obtain assistance. In addition, if the user does not select manual help for the first operation prompt, but the user still cannot correctly operate the first operation object, for example, voice operation information input by the user fails, or complaints or anger generation generated by the user is detected, it can be directly determined that the user needs manual help, so that help is provided for the user in time, and the user experience is improved.
In summary, in the prompt method provided in the above embodiment, when it is determined that the user wishes to obtain the help prompt for the operation object according to the input operation information, the prompt message for operating the operation object is automatically presented, so that the user can quickly obtain the operation instruction for the operation object, the operation is simple and convenient, and the user experience is improved.
Based on the same inventive concept of the foregoing embodiments, the present embodiment describes the technical solutions of the foregoing embodiments in detail through different application scenarios.
In a first scenario, it is assumed that a user is currently playing songs by using a music application of a car machine, and if the user currently wants to switch songs and wants to switch songs in a voice mode, the user can press a "next" key for a long time, and a suspended window containing a help key is displayed above the "next" key, which is specifically shown in fig. 2; when the user clicks the help button, the car machine will display a help page indicating how to fast switch the song by voice, such as "next", "previous", and the like, as shown in fig. 3.
A second scenario is that a user is supposed to play a song by using a music application of the car machine at present, and if the user feels that manual operation is troublesome after clicking a next button at present, the user inputs voice again to 'how to quickly switch to the next song', which is specifically shown in fig. 4; the car machine learns that the user has a requirement for fast song switching according to the operation of clicking the next button on the music playing interface by the user and the voice, and can display a help page for fast song switching by the voice at the moment, and specifically please refer to fig. 3 again.
And a third scenario, assuming that how to switch the view angle when the user inputs the voice to the car machine for multiple times, "see fig. 5 specifically, because the voice is not the control voice for switching the navigation view angle, the car machine may not successfully recognize, but after the continuous recognition of the voice input by the user fails for two or more times, the car machine may extract keywords" navigation, "switching," "view angle," and the like in the voice input by the user, and further learn how to switch the navigation view angle by voice according to the keywords, at this time, the car machine may display a help page for how to switch the navigation view angle by voice, see fig. 6 specifically.
And a fourth scenario, assuming that the user is currently playing songs by using the music application of the car machine, and at this time, when the car machine detects that the loop playing key in the current music playing interface is not used, a text suspension window can be displayed below the loop playing key, and contents such as "click the key to realize loop playing of the current songs" are displayed in the text suspension window, which is specifically shown in fig. 7.
A fifth scene that a user can not use a certain button or a certain function on the vehicle, the button or the function is scanned and scanned by using a mobile phone at the moment, and the vehicle machine displays a prompt function and a help video; or when a certain lamp on the vehicle is flashing, the vehicle is swept to display a prompt function and a help video. The mobile phone is used for scanning an operation object needing to be helped, the screen of the vehicle machine displays help in real time, and a user does not need to check help information on the mobile phone; in addition, after the operation object is scanned and identified, the identified operation object can be highlighted, then characters are simply prompted, then voice prompt is performed, then more video prompt is performed, and the prompt capability is helped to be prompted from simple to complex, but not immediately displayed. Therefore, the time for helping search by the user is reduced, searching is not needed, and the voice and the operation context are naturalized according to the requirement of artificial habits; the related help content is obtained more quickly and accurately, and the user operation is simple and easy to understand.
Scene six, if the user fails to recognize the voice input for 3 times continuously, the voice may be abnormal or the interference is too large, the user does not know what reason, and at the moment, a prompt of 'a little peace and no irritability, and we will contact with you later to inform the reason of the operation failure' is provided; the user repeats one operation for many times, but does not start complaining and generating, and gives a help prompt "you may need manual online help and need to access manual service" after timely background identification.
And a seventh scene, after a certain operation object has a new voice skill, calling the teaching management module, generating a teaching prompt of the skill, namely an operation prompt of the operation object according to the new on-line skill, wherein the prompt comprises unlimited information { tts broadcast words, whether the voice instruction is broadcast and executed at the same time to demonstrate to a user, a prompter is displayed on an instrument, the teaching instruction is scheduled in certain scenes, the priority of the newly generated information is higher, when the user logs in the vehicle machine system, the vehicle machine pulls the latest teaching list from the background server, the latest teaching content is the information set above, and the information is scheduled in accordance with the scenes, so that the teaching instruction is dynamically configured, the teaching instruction can be dynamically upgraded along with the upgrading of the background on-line voice skill base, and the user experience is greatly improved.
Based on the same inventive concept as the foregoing embodiment, an embodiment of the present invention provides a prompting device, as shown in fig. 8, including: a processor 110 and a memory 111 for storing computer programs capable of running on the processor 110; the processor 110 illustrated in fig. 8 is not used to refer to the number of the processors 110 as one, but is only used to refer to the position relationship of the processor 110 relative to other devices, and in practical applications, the number of the processors 110 may be one or more; similarly, the memory 111 illustrated in fig. 8 is also used in the same sense, that is, only used to refer to the position relationship of the memory 111 relative to other devices, and in practical applications, the number of the memory 111 may be one or more.
Wherein, when the processor 110 is used to run the computer program, the following steps are executed:
acquiring input operation information, wherein the operation information comprises at least one of touch operation information, voice operation information and shooting image information of a first operation object;
identifying the first operation object based on the operation information; and
and presenting a first operation prompt related to the first operation object under the condition that the operation information meets a preset condition.
Therefore, when the input operation information is determined to meet the preset conditions, the prompt message for operating the operation object is automatically presented, the user can quickly obtain the operation instruction for the operation object, the operation is simple and convenient, and the user experience is improved.
In one embodiment, the processor 110 is configured to execute the computer program to perform the following steps:
intercepting a target image in the shot image information, matching the target image with a preset image in a first database to determine a preset image with the highest matching degree, and determining a preset operation object associated with the preset image as the first operation object based on the preset image; the first database stores different preset operation objects and associated preset images; and
identifying a target keyword in the shot image information, matching the target keyword with a first preset keyword in a second database to determine a first preset keyword with the highest matching degree, and determining a preset operation object associated with the first preset keyword as the first operation object based on the first preset keyword; the second database stores different preset operation objects and associated first preset keywords.
Therefore, the first operation object is determined based on the image or the keyword in the shot image information, the operation is convenient and fast, and the accuracy is high.
In one embodiment, the touch operation information includes a touch duration of the touch operation and/or a touch frequency of the touch operation.
In one embodiment, the preset condition comprises at least one of the following conditions:
the touch duration of the touch operation meets a first duration preset condition;
the touch frequency of the touch operation meets a frequency preset condition;
the frequency of continuous recognition failure of the input voice operation information meets the frequency preset condition; and
and detecting that the input time interval between the touch operation information and the voice operation information is smaller than a preset time threshold, and recognizing that the voice operation information contains a second preset keyword.
Therefore, the operation information is detected through the set different preset conditions to judge whether the first operation prompt about the first operation object needs to be presented or not, the operation prompt is flexible and convenient, and the user use experience is further improved.
In one embodiment, the processor 110 is configured to execute the computer program to perform the following steps:
identifying at least one function keyword related to the first operation object in the voice operation information; and
retrieving a preset third database based on the at least one functional keyword, and acquiring and presenting a first operation prompt related to the first operation object; and the third database stores at least one function keyword and associated first operation prompts of different first operation objects.
Therefore, by identifying the function keywords related to the operation object contained in the voice and further acquiring the operation prompt related to the operation object based on the function keywords, the operation is convenient and fast, and the accuracy is high.
In one embodiment, the processor 110 is configured to execute the computer program to perform the following steps:
acquiring an update instruction for updating the third database, wherein the update instruction comprises an update configuration node and an update configuration file, the update configuration node is used for indicating one of a first operation object, a function keyword and a first operation prompt to be updated, and the update configuration file comprises at least one of the first operation object, the function keyword and the first operation prompt to be updated, which are associated with the update configuration node;
and replacing or adding the update configuration file at an update configuration node based on the update instruction so as to replace or add at least one of the first operation object, the function keyword and the first operation prompt to be updated in the third database.
Therefore, the operation object, the function keywords, the operation prompt and the like can be updated quickly and conveniently, and the user experience is further improved.
In one embodiment, the processor 110 is configured to execute the computer program to perform the following steps:
determining a display position and/or a display area size of the first operation prompt based on an input adjustment instruction or a change of an operation interface so as to present the first operation prompt about the first operation object;
determining a background transparency of the first operation prompt so that the first operation prompt about the first operation object is presented; and
presenting, at an electronic device, the first operation prompt regarding the first operation object.
Therefore, the first operation prompt about the first operation object is presented in different modes, the prompt can be effectively carried out on the user, meanwhile, the shielding of the operation interface can be avoided or reduced as much as possible, the user can conveniently carry out other operations, and the user use experience is further improved.
In one embodiment, the processor 110 is configured to execute the computer program to perform the following steps:
displaying a document or a character containing a first operation prompt related to the first operation object;
displaying a small video or page containing a first operation prompt related to the first operation object;
displaying a hanging window containing a help key, wherein the help key is used for triggering and displaying a first operation prompt related to the first operation object; and
and broadcasting voice containing a first operation prompt related to the first operation object.
Therefore, the first operation prompt about the first operation object is presented in different modes, the prompt can be effectively carried out on the user, and the user use experience is further improved.
In one embodiment, the processor 110 is configured to execute the computer program to perform the following steps: and displaying a second operation prompt related to a second operation object under the condition that the second operation object meeting the prompt condition exists in the current operation interface.
Therefore, the viscosity of a user can be effectively improved.
In one embodiment, the prompt condition includes at least one of that the second operation object is not activated, and that the unused time length of the second operation object satisfies a second time length preset condition.
In one embodiment, the processor 110 is configured to execute the computer program to perform the following steps: and closing a first operation prompt related to the first operation object under the condition that a preset closing prompt operation is detected.
Therefore, after the preset closing prompt operation is detected, the first operation prompt related to the first operation object is closed in time, so that a user can conveniently execute other operations, and the user experience is further improved.
In one embodiment, the first operation prompt includes a prompt message indicating whether manual assistance is required, and the processor 110 is configured to execute the following steps when running the computer program: in the event that it is determined that manual assistance is needed, transition is made to a manual service mode to obtain assistance.
Therefore, help can be provided for the user in time, and the user experience is improved.
The prompting device can also comprise: at least one network interface 112. The various components of the prompting device are coupled together by a bus system 113. It will be appreciated that the bus system 113 is used to enable communications among the components of the connection. The bus system 113 includes a power bus, a control bus, and a status signal bus in addition to the data bus. For clarity of illustration, however, the various buses are labeled as bus system 113 in FIG. 8.
The memory 111 may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memories. Among them, the nonvolatile Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a magnetic random access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical disk, or a Compact Disc Read-Only Memory (CD-ROM); the magnetic surface storage may be disk storage or tape storage. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Enhanced Synchronous Dynamic Random Access Memory (Enhanced DRAM), Synchronous Dynamic Random Access Memory (SLDRAM), Direct Memory (DRmb Access), and Random Access Memory (DRAM). The memory 111 described in connection with the embodiments of the invention is intended to comprise, without being limited to, these and any other suitable types of memory.
The memory 111 in embodiments of the present invention is used to store various types of data to support the operation of the prompting device. Examples of such data include: any computer program for operating on the prompting device, such as operating systems and application programs; contact data; telephone book data; a message; a picture; video, etc. The operating system includes various system programs, such as a framework layer, a core library layer, a driver layer, and the like, and is used for implementing various basic services and processing hardware-based tasks. The application programs may include various application programs such as a Media Player (Media Player), a Browser (Browser), etc. for implementing various application services. Here, the program that implements the method of the embodiment of the present invention may be included in an application program.
Based on the same inventive concept of the foregoing embodiments, this embodiment further provides a computer storage medium, where a computer program is stored in the computer storage medium, where the computer storage medium may be a Memory such as a magnetic random access Memory (FRAM), a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read Only Memory (EPROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical Disc, or a Compact Disc Read Only Memory (CD-ROM), and the like; or may be a variety of devices including one or any combination of the above memories, such as a mobile phone, computer, tablet device, personal digital assistant, etc.
Wherein the computer program, when executed by a processor, performs the steps of:
acquiring input operation information, wherein the operation information comprises at least one of touch operation information, voice operation information and shooting image information of a first operation object;
identifying the first operation object based on the operation information; and
and presenting a first operation prompt related to the first operation object under the condition that the operation information meets a preset condition.
Therefore, when the input operation information is confirmed to meet the preset conditions, the prompt message for operating the operation object is automatically presented, the user can quickly obtain the operation instruction for the operation object, the operation is simple and convenient, and the user use experience is improved.
In one embodiment, the computer program, when executed by a processor, performs the steps of:
intercepting a target image in the shot image information, matching the target image with a preset image in a first database to determine a preset image with the highest matching degree, and determining a preset operation object associated with the preset image as the first operation object based on the preset image; the first database stores different preset operation objects and associated preset images; and
identifying a target keyword in the shot image information, matching the target keyword with a first preset keyword in a second database to determine a first preset keyword with the highest matching degree, and determining a preset operation object associated with the first preset keyword as the first operation object based on the first preset keyword; the second database stores different preset operation objects and associated first preset keywords.
Therefore, the first operation object is determined based on the image or the keyword in the shot image information, the operation is convenient and fast, and the accuracy is high.
In one embodiment, the touch operation information includes a touch duration of the touch operation and/or a touch frequency of the touch operation.
In one embodiment, the preset condition comprises at least one of the following conditions:
the touch duration of the touch operation meets a first duration preset condition;
the touch frequency of the touch operation meets a frequency preset condition;
the frequency of continuous recognition failure of the input voice operation information meets the frequency preset condition; and
and detecting that the input time interval between the touch operation information and the voice operation information is smaller than a preset time threshold, and recognizing that the voice operation information contains a second preset keyword.
Therefore, the operation information is detected through the set different preset conditions to judge whether the first operation prompt about the first operation object needs to be presented or not, the operation prompt is flexible and convenient, and the user use experience is further improved.
In one embodiment, the computer program, when executed by a processor, performs the steps of:
identifying at least one function keyword related to the first operation object in the voice operation information; and
retrieving a preset third database based on the at least one functional keyword, and acquiring and presenting a first operation prompt related to the first operation object; and the third database stores at least one function keyword and associated first operation prompts of different first operation objects.
Therefore, by identifying the function keywords related to the operation object contained in the voice and further acquiring the operation prompt related to the operation object based on the function keywords, the operation is convenient and fast, and the accuracy is high.
In one embodiment, the computer program, when executed by a processor, performs the steps of:
acquiring an update instruction for updating the third database, wherein the update instruction comprises an update configuration node and an update configuration file, the update configuration node is used for indicating one of a first operation object, a function keyword and a first operation prompt to be updated, and the update configuration file comprises at least one of the first operation object, the function keyword and the first operation prompt to be updated, which are associated with the update configuration node;
and replacing or adding the update configuration file at an update configuration node based on the update instruction so as to replace or add at least one of the first operation object, the function keyword and the first operation prompt to be updated in the third database.
Therefore, the operation object, the function keywords, the operation prompt and the like can be updated quickly and conveniently, and the user experience is further improved.
In one embodiment, the computer program, when executed by a processor, performs the steps of:
determining a display position and/or a display area size of the first operation prompt based on an input adjustment instruction or a change of an operation interface so as to present the first operation prompt about the first operation object;
determining a background transparency of the first operation prompt so that the first operation prompt about the first operation object is presented; and
presenting, at an electronic device, the first operation prompt regarding the first operation object.
Therefore, the first operation prompt about the first operation object is presented in different modes, the prompt can be effectively carried out on the user, meanwhile, the shielding of the operation interface can be avoided or reduced as much as possible, the user can conveniently carry out other operations, and the user use experience is further improved.
In one embodiment, the computer program, when executed by a processor, performs the steps of:
displaying a document or a character containing a first operation prompt related to the first operation object;
displaying a small video or page containing a first operation prompt related to the first operation object;
displaying a hanging window containing a help key, wherein the help key is used for triggering and displaying a first operation prompt related to the first operation object; and
and broadcasting voice containing a first operation prompt related to the first operation object.
Therefore, the first operation prompt about the first operation object is presented in different modes, the prompt can be effectively carried out on the user, and the user use experience is further improved.
In one embodiment, the computer program, when executed by a processor, performs the steps of: and displaying a second operation prompt related to a second operation object under the condition that the second operation object meeting the prompt condition exists in the current operation interface.
Therefore, the viscosity of a user can be effectively improved.
In one embodiment, the prompt condition includes at least one of that the second operation object is not activated, and that the unused time length of the second operation object satisfies a second time length preset condition.
In one embodiment, the computer program, when executed by a processor, performs the steps of: and closing a first operation prompt related to the first operation object under the condition that a preset closing prompt operation is detected.
Therefore, after the preset closing prompt operation is detected, the first operation prompt related to the first operation object is closed in time, so that a user can conveniently execute other operations, and the user experience is further improved.
In one embodiment, the first operation prompt comprises a prompt message indicating whether manual assistance is required, and the computer program when executed by the processor performs the steps of: in the event that it is determined that manual assistance is needed, transition is made to a manual service mode to obtain assistance.
Therefore, help can be provided for the user in time, and the user use experience is improved.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
As used herein, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, including not only those elements listed, but also other elements not expressly listed.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.

Claims (14)

1. A method of prompting, the method comprising the steps of:
acquiring input operation information, wherein the operation information comprises at least one of touch operation information, voice operation information and shooting image information of a first operation object;
identifying the first operation object based on the operation information; and
and presenting a first operation prompt related to the first operation object under the condition that the operation information meets a preset condition.
2. The method of claim 1, wherein identifying the first operation object based on the operation information comprises at least one of:
intercepting a target image in the shot image information, matching the target image with a preset image in a first database to determine a preset image with the highest matching degree, and determining a preset operation object associated with the preset image as the first operation object based on the preset image; the first database stores different preset operation objects and associated preset images; and
identifying a target keyword in the shot image information, matching the target keyword with a first preset keyword in a second database to determine a first preset keyword with the highest matching degree, and determining a preset operation object associated with the first preset keyword as the first operation object based on the first preset keyword; the second database stores different preset operation objects and associated first preset keywords.
3. The method of claim 1, wherein the touch operation information comprises a touch duration of the touch operation and/or a touch frequency of the touch operation.
4. The method of any one of claims 1 to 3, the preset conditions comprising at least one of:
the touch duration of the touch operation meets a first duration preset condition;
the touch times of the touch operation meet a preset time condition;
the frequency of continuous recognition failure of the input voice operation information meets the frequency preset condition; and
and detecting that the input time interval between the touch operation information and the voice operation information is smaller than a preset time threshold, and recognizing that the voice operation information contains a second preset keyword.
5. The method of claim 1, said presenting a first operation hint regarding said first operation object, comprising the steps of:
identifying at least one function keyword related to the first operation object in the voice operation information; and
retrieving a preset third database based on the at least one functional keyword, and acquiring and presenting a first operation prompt related to the first operation object; and the third database stores at least one function keyword and associated first operation prompts of different first operation objects.
6. The method of claim 5, the third database being updatable based on:
acquiring an update instruction for updating the third database, wherein the update instruction comprises an update configuration node and an update configuration file, the update configuration node is used for indicating one of a first operation object, a function keyword and a first operation prompt to be updated, and the update configuration file comprises at least one of the first operation object, the function keyword and the first operation prompt to be updated, which are associated with the update configuration node;
and replacing or adding the update configuration file at an update configuration node based on the update instruction so as to replace or add at least one of the first operation object, the function keyword and the first operation prompt to be updated in the third database.
7. The method of claim 1, said presenting a first operation hint regarding said first operation object, comprising at least one of:
determining a display position and/or a display area size of the first operation prompt based on an input adjustment instruction or a change of an operation interface so as to present the first operation prompt about the first operation object;
determining a background transparency of the first operation cue so as to present the first operation cue with respect to the first operation object; and
presenting, at an electronic device, the first operation prompt regarding the first operation object.
8. The method of claim 1, said presenting a first operation hint regarding said first operation object, comprising at least one of:
displaying a document or a character containing a first operation prompt related to the first operation object;
displaying a small video or page containing a first operation prompt related to the first operation object;
displaying a hanging window containing a help key, wherein the help key is used for triggering and displaying a first operation prompt related to the first operation object; and
and broadcasting voice containing a first operation prompt related to the first operation object.
9. The method of claim 1, further comprising the steps of:
and displaying a second operation prompt related to a second operation object under the condition that the second operation object meeting the prompt condition exists in the current operation interface.
10. The method of claim 9, wherein the prompt condition includes at least one of that the second operation object is not activated, and that the unused time length of the second operation object satisfies a second time length preset condition.
11. The method of claim 1, further comprising the steps of:
and closing a first operation prompt related to the first operation object under the condition that a preset closing prompt operation is detected.
12. The method of claim 1, wherein the first operation prompt comprises a prompt message indicating whether human assistance is required, and wherein the step of, after presenting the first operation prompt relating to the first operation object, further comprises:
in the event that it is determined that manual assistance is needed, transition is made to a manual service mode to obtain assistance.
13. A cueing device comprising: a memory configured to store one or more computer programs; and a processor coupled to the memory and configured to execute the one or more computer programs to cause the electronic device to perform the steps of the method of any of claims 1-12.
14. A computer storage medium, in which a computer program is stored, which, when being executed by a processor, carries out the steps of the prompting method according to any one of claims 1 to 12.
CN202110117883.4A 2020-12-31 2021-01-28 Prompting method, prompting device and computer storage medium Active CN114690992B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310756068.1A CN116680033A (en) 2020-12-31 2021-01-28 Prompting method, prompting device and computer storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011637673 2020-12-31
CN202011637673X 2020-12-31

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202310756068.1A Division CN116680033A (en) 2020-12-31 2021-01-28 Prompting method, prompting device and computer storage medium

Publications (2)

Publication Number Publication Date
CN114690992A true CN114690992A (en) 2022-07-01
CN114690992B CN114690992B (en) 2023-06-27

Family

ID=82135578

Family Applications (4)

Application Number Title Priority Date Filing Date
CN202310756068.1A Pending CN116680033A (en) 2020-12-31 2021-01-28 Prompting method, prompting device and computer storage medium
CN202110117883.4A Active CN114690992B (en) 2020-12-31 2021-01-28 Prompting method, prompting device and computer storage medium
CN202110123503.8A Active CN114691261B (en) 2020-12-31 2021-01-28 Prompting method, prompting device, electronic equipment and computer storage medium
CN202110296429.XA Active CN114764363B (en) 2020-12-31 2021-03-19 Prompting method, prompting device and computer storage medium

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN202310756068.1A Pending CN116680033A (en) 2020-12-31 2021-01-28 Prompting method, prompting device and computer storage medium

Family Applications After (2)

Application Number Title Priority Date Filing Date
CN202110123503.8A Active CN114691261B (en) 2020-12-31 2021-01-28 Prompting method, prompting device, electronic equipment and computer storage medium
CN202110296429.XA Active CN114764363B (en) 2020-12-31 2021-03-19 Prompting method, prompting device and computer storage medium

Country Status (1)

Country Link
CN (4) CN116680033A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116185190A (en) * 2023-02-09 2023-05-30 江苏泽景汽车电子股份有限公司 Information display control method and device and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110271185A1 (en) * 2010-04-30 2011-11-03 International Business Machines Corporation Providing a context-aware help content using a transparent overlay on a touch sensitive screen
WO2019020008A1 (en) * 2017-07-26 2019-01-31 维沃移动通信有限公司 Missed call prompt method, and mobile terminal
US20190121537A1 (en) * 2016-05-12 2019-04-25 Beijing Kingsoft Internet Security Software Co., Ltd. Information displaying method and device, and electronic device
US20190362720A1 (en) * 2018-05-28 2019-11-28 Baidu Online Network Technology (Beijing) Co., Ltd. Speech interactive method and device
CN112017646A (en) * 2020-08-21 2020-12-01 博泰车联网(南京)有限公司 Voice processing method and device and computer storage medium

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101159703A (en) * 2007-10-09 2008-04-09 施侃晟 Bidirectional interdynamic search method for generating instant communication effect
CN108037885A (en) * 2017-11-27 2018-05-15 维沃移动通信有限公司 A kind of operation indicating method and mobile terminal
CN109656512A (en) * 2018-12-20 2019-04-19 Oppo广东移动通信有限公司 Exchange method, device, storage medium and terminal based on voice assistant
CN110072140B (en) * 2019-03-22 2021-05-28 厦门理工学院 Video information prompting method, device, equipment and storage medium
CN111506245A (en) * 2020-04-27 2020-08-07 北京小米松果电子有限公司 Terminal control method and device
CN111664861B (en) * 2020-06-02 2023-02-28 阿波罗智联(北京)科技有限公司 Navigation prompting method, device, equipment and readable storage medium
CN111580724B (en) * 2020-06-28 2021-12-10 腾讯科技（深圳）有限公司 Information interaction method, equipment and storage medium
CN112148408A (en) * 2020-09-27 2020-12-29 深圳壹账通智能科技有限公司 Barrier-free mode implementation method and device based on image processing and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110271185A1 (en) * 2010-04-30 2011-11-03 International Business Machines Corporation Providing a context-aware help content using a transparent overlay on a touch sensitive screen
US20190121537A1 (en) * 2016-05-12 2019-04-25 Beijing Kingsoft Internet Security Software Co., Ltd. Information displaying method and device, and electronic device
WO2019020008A1 (en) * 2017-07-26 2019-01-31 维沃移动通信有限公司 Missed call prompt method, and mobile terminal
US20190362720A1 (en) * 2018-05-28 2019-11-28 Baidu Online Network Technology (Beijing) Co., Ltd. Speech interactive method and device
CN112017646A (en) * 2020-08-21 2020-12-01 博泰车联网(南京)有限公司 Voice processing method and device and computer storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116185190A (en) * 2023-02-09 2023-05-30 江苏泽景汽车电子股份有限公司 Information display control method and device and electronic equipment
CN116185190B (en) * 2023-02-09 2024-05-10 江苏泽景汽车电子股份有限公司 Information display control method and device and electronic equipment

Also Published As

Publication number Publication date
CN114691261B (en) 2024-07-05
CN114764363A (en) 2022-07-19
CN116680033A (en) 2023-09-01
CN114691261A (en) 2022-07-01
CN114764363B (en) 2023-11-24
CN114690992B (en) 2023-06-27

Similar Documents

Publication Publication Date Title
JP7065740B2 (en) Application function information display method, device, and terminal device
WO2020010814A1 (en) Method and apparatus for selecting background music for video capture, terminal device, and medium
US10739958B2 (en) Method and device for executing application using icon associated with application metadata
US11389961B2 (en) Article searching method and robot thereof
CN109189879B (en) Electronic book display method and device
KR20140089751A (en) Method for intelligent searching service using circumstance recognition and the terminal thereof
EP2455871A2 (en) Mobile terminal and method of managing video using metadata therein
CN109408181B (en) Equipment skill display method and device
CN111968640B (en) Voice control method, voice control device, electronic equipment and storage medium
CN109165052B (en) Interactive processing method and device of application scene, terminal, system and storage medium
CN112752121B (en) Video cover generation method and device
KR20210010521A (en) Method, device, terminal device, and storage medium for sharing personal information
JP2019204525A (en) Screen control method, equipment device, and computer readable storage medium
KR20140100315A (en) Mobile terminal and control method thereof
CN104461348A (en) Method and device for selecting information
EP2587359B1 (en) Method and apparatus for making personalized contents
CN114690992A (en) Prompting method and device and computer storage medium
WO2024109699A1 (en) Display method and apparatus, electronic device, and medium
CN108062952B (en) Voice control method, device and system
CN107688617B (en) Multimedia service method and mobile terminal
JP2002259011A (en) Personal digital assistant and its screen updating program
KR101710543B1 (en) Mobile terminal and control method for mobile terminal
CN111752436A (en) Recommendation method and device and recommendation device
CN110955332A (en) Man-machine interaction method and device, mobile terminal and computer readable storage medium
CN107862728B (en) Picture label adding method and device and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant