CN116107680A - Operation guiding method and device of mobile terminal and electronic equipment - Google Patents

Operation guiding method and device of mobile terminal and electronic equipment Download PDF

Info

Publication number
CN116107680A
CN116107680A CN202310134380.7A CN202310134380A CN116107680A CN 116107680 A CN116107680 A CN 116107680A CN 202310134380 A CN202310134380 A CN 202310134380A CN 116107680 A CN116107680 A CN 116107680A
Authority
CN
China
Prior art keywords
user
mobile terminal
information
target
page
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310134380.7A
Other languages
Chinese (zh)
Inventor
徐迎迎
陈锋
蔡鹏�
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Du Xiaoman Technology Beijing Co Ltd
Original Assignee
Du Xiaoman Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Du Xiaoman Technology Beijing Co Ltd filed Critical Du Xiaoman Technology Beijing Co Ltd
Priority to CN202310134380.7A priority Critical patent/CN116107680A/en
Publication of CN116107680A publication Critical patent/CN116107680A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • G06F9/453Help systems

Abstract

The disclosure provides an operation guiding method and device of a mobile terminal and electronic equipment, wherein the method comprises the following steps: acquiring a page where a current operation of a user on a mobile terminal is located; identifying a target type tag corresponding to a page where the current operation is located; acquiring target operation guide information corresponding to the target type tag, wherein the target operation guide information is used for indicating subsequent operations required to be executed by a user; and outputting guiding information of the next operation of the user according to the target operation guiding information, and guiding the next operation of the user in real time based on the current operation of the user. By the method and the device, the problem that the operation guiding method of the mobile terminal in the related technology is poor in guiding effect and efficiency can be solved, and the technical effects of improving the operation guiding efficiency and guiding effect of the mobile terminal are achieved.

Description

Operation guiding method and device of mobile terminal and electronic equipment
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method and an apparatus for guiding operation of a mobile terminal, and an electronic device.
Background
In the process of completing various business processes by using an APP (application program) in a mobile device, the probability that a user cannot complete an operation or completes the operation is low often caused by various reasons, and common reasons are as follows:
1) User plane: users are unfamiliar with the conventional operation of software and mobile phones, are old, have low education degree and the like, and cannot efficiently complete the appointed operation steps according to the text prompt and the operation habit as expected by a product designer;
2) The operation flow is as follows: the user's completion probability is low due to the complex operation steps such as crossing multiple APP, multiple information input, various abnormal conditions in the operation process, and the like, so that the overall completion rate is reduced, and the service conversion rate is further influenced.
Common implementation manners for guiding a user to complete complex operations in the related art are classified into the following three types:
1. fixed position display operating instructions
The user operation steps are written into the explanation, the user is required to operate and read the operation explanation, but the operation window is smaller at the mobile phone end, the operation is unrealistic when the explanation is checked, the user is required to memorize the operation, and the forgetting probability is high, so that the meaning of the static operation explanation navigation at the mobile end is not great.
2. Continuous display of operating instructions by means of a suspended window
The method has the advantages that the static operation step, namely static operation navigation, is displayed by suspending a window on the desktop of the APP, no matter where a user operates, the window is suspended on the desktop, the problem that the user operates while looking at an operation document is solved, the content in the static sliding suspension window still needs to correspond to the maintenance of the current position, the text content is understood and jumps to the next step, in addition, the defects that abnormal branches and text understanding capability cannot be processed are overcome, and the authority of the user for manually opening the suspension window is increased are overcome.
3. On-site or remote manual instruction
The operation flow is guided by contacting the manual customer service through the on-site help person or the remote telephone and the audio/video mode, so that the problem can be solved relatively directly, but the cost is relatively high, such as the working time of the customer service, the cost for describing the problem capability and the like, and the problem of relatively obvious labor cost is solved, and the similar and repeatable problems are continuously solved by the customer service.
At present, the operation guiding method of the mobile terminal in the related art has poor guiding effect and efficiency, and no effective solution has been proposed.
Disclosure of Invention
An object of the present disclosure is to provide an operation guiding method, apparatus, electronic device and computer readable storage medium for a mobile terminal, which address at least the problem that the operation guiding method for a mobile terminal in the related art is poor in guiding effect and efficiency.
According to an aspect of the present disclosure, there is provided an operation guidance method of a mobile terminal, including:
acquiring a page where a current operation of a user on a mobile terminal is located;
identifying a target type tag corresponding to a page where the current operation is located;
acquiring target operation guide information corresponding to the target type tag, wherein the target operation guide information is used for indicating subsequent operations required to be executed by a user;
and outputting the guiding information of the next operation of the user according to the target operation guiding information.
According to another aspect of the present disclosure, there is provided an operation guide apparatus of a mobile terminal, including:
the first acquisition unit is used for acquiring a page where a current operation of the mobile terminal is located;
the identification unit is used for identifying a target type label corresponding to the page where the current operation is located;
a second obtaining unit, configured to obtain target operation guiding information corresponding to the target type tag, where the target operation guiding information is used to indicate a subsequent operation that needs to be performed by a user;
and the output unit is used for outputting the guiding information of the next operation of the user according to the target operation guiding information.
According to another aspect of the present disclosure, there is provided an electronic device including:
a processor; and
a memory in which a program is stored,
wherein the program comprises instructions which, when executed by the processor, cause the processor to perform the operation guidance method of the mobile terminal in the present disclosure.
According to another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform the operation guidance method of the mobile terminal in the present disclosure.
According to the one or more technical schemes provided by the embodiment of the disclosure, a page where a current operation of a user on a mobile terminal is located is obtained; then identifying a target type tag corresponding to the page where the current operation is located; then obtaining target operation guide information corresponding to the target type label, wherein the target operation guide information is used for indicating subsequent operations required to be executed by a user; and finally, outputting the guiding information of the next operation of the user according to the target operation guiding information, and guiding the next operation of the user in real time based on the current operation of the user, so that the problem that the operation guiding method of the mobile terminal in the related technology is poor in guiding effect and efficiency can be solved, and the technical effects of improving the operation guiding efficiency and guiding effect of the mobile terminal are realized.
Drawings
Further details, features and advantages of the present disclosure are disclosed in the following description of exemplary embodiments, with reference to the following drawings, wherein:
FIG. 1 illustrates a schematic diagram of an example system in which various methods described herein may be implemented, according to an example embodiment of the present disclosure;
fig. 2 illustrates a flowchart of an operation guidance method of a mobile terminal according to an exemplary embodiment of the present disclosure;
FIG. 3 illustrates a flow chart of a method of intelligent booting within a mobile terminal APP, according to an exemplary embodiment of the disclosure;
FIG. 4 shows a schematic diagram of a user experience flow according to an exemplary embodiment of the present disclosure;
fig. 5 shows a schematic block diagram of an operation guide device of a mobile terminal according to an exemplary embodiment of the present disclosure;
fig. 6 illustrates a block diagram of an exemplary electronic device that can be used to implement embodiments of the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure have been shown in the accompanying drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order and/or performed in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "including" and variations thereof as used herein are intended to be open-ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments. Related definitions of other terms will be given in the description below. It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.
It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.
The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.
Aspects of the present disclosure are described below with reference to the accompanying drawings.
In the process of completing various business processes by using an APP (application program) in a mobile device, the probability that a user cannot complete the operation or completes the operation is low often due to various reasons, and although the operation guiding scheme in the related technology solves the operation problem of some people to a certain extent, the operation guiding scheme still cannot accurately and efficiently guide the user.
In view of the foregoing, exemplary embodiments of the present disclosure provide an operation guidance method of a mobile terminal. The operation guidance method of the mobile terminal may be performed at the mobile terminal side.
The architecture of the intelligent operating system in the mobile terminal APP of the exemplary embodiment of the present disclosure is shown in fig. 1, and the overall system architecture is mainly divided into four parts: the system comprises an image recognition machine learning platform, a navigation strategy low-code labeling platform, a cloud control platform based on image intelligent recognition and an end-side intelligent framework on a user mobile phone.
Image recognition machine learning platform: the model training suitable for running on the mobile terminal mainly completes the classification and identification of the specific pictures and comprises three parts: on-line labeling of picture samples, training of an image classification model, compression and deployment of the image classification model.
Navigation strategy low code labeling platform: the visual editing of the picture interface navigation prompt is mainly completed, the association of the picture label and the prompt text is realized through the dragging of the picture and the editing of the prompt text, the research and the development access are not needed, and the generation of the navigation strategy package is realized by a low code; the prompt voice supports server voice generation and client voice generation, and different selections are carried out according to different scenes. The two modes are automatically completed without depending on manual intervention. The navigation strategy low-code labeling platform comprises three parts: selecting picture labels, navigating text labels, and labeling corresponding relation between the labels and the text.
Cloud control platform based on image intelligent recognition: the intelligent picture identification model library and the navigation strategy package generated by the two previous platforms are convenient to download according to the need in a CDN resource mode, and the strategy module downloads and updates according to the version and the operation flow of the current APP and the content of the intelligent picture identification model library and the navigation strategy package downloaded by the current mobile phone.
End side intelligent framework: the APP comprises a framework capable of running specific machine learning, a specific picture intelligent recognition model library can be loaded, a current page is recognized in a screen recording mode in the operation process of a user, then the content in a navigation strategy package is analyzed, and guiding voice is played, so that intelligent guiding is realized.
Based on the system architecture of the mobile terminal, fig. 2 shows a flowchart of an operation guiding method of the mobile terminal according to an exemplary embodiment of the present disclosure, as shown in fig. 2, the method includes the steps of:
step S201, acquiring a page where a current operation of a user on a mobile terminal is located;
step S202, identifying a target type label corresponding to the page where the current operation is located;
step S203, obtaining target operation guiding information corresponding to the target type label, wherein the target operation guiding information is used for indicating a subsequent operation required to be executed by a user;
step S204, outputting the guiding information of the next operation of the user according to the target operation guiding information.
In some embodiments, the step S202 of identifying the target type tag corresponding to the page on which the current operation is performed includes:
inputting the page where the current operation is located into a trained intelligent image recognition model library to obtain the target type label corresponding to the page where the current operation is located, wherein the intelligent image recognition model library is used for indicating the corresponding relation between the page and the type label of the page.
It should be noted that, the classification training process of the intelligent image recognition model library is not limited herein, and the trained intelligent image recognition model library may indicate the corresponding relationship between the pages and the type labels of the pages.
In some embodiments, the step S203 of obtaining the target operation guiding information corresponding to the target type tag includes:
inquiring target operation guiding information corresponding to the target type label from a navigation strategy package, wherein the navigation strategy package can be pre-established, and the navigation strategy package can be pre-stored with: the method comprises the steps of page type labels, operation guide information and corresponding relation between the page type labels and the operation guide information.
In some embodiments, after the step S204 of outputting the guiding information of the next operation of the user according to the target operation guiding information, the method may further include:
judging whether the next operation executed by the user is correct;
if the next operation performed by the user is correct, determining the next operation as the current operation, and performing the step S201 to obtain a page where the current operation of the user on the mobile terminal is located;
and if the next operation performed by the user is wrong, outputting the guide information of the page where the current operation is returned by the user.
In some embodiments, the outputting, by the step S204, the guiding information of the next operation of the user according to the target operation guiding information may include:
according to the target operation guiding information, broadcasting guiding information of the next operation of the user in a voice mode; or alternatively
Marking the operation area of the next operation on the page where the current operation is located according to the target operation guiding information. The labeling mode is not particularly limited in the embodiments of the present disclosure, and may be highlighting, blinking, or the like.
In some embodiments, the outputting, by the step S204, the guiding information of the next operation of the user according to the target operation guiding information may include:
after the target operation guide information is obtained from the server, the mobile terminal generates guide information of next operation of the user according to the target operation guide information, and outputs the guide information of next operation of the user; or alternatively
After the guiding information of the next operation of the user is obtained from the server, the mobile terminal outputs the guiding information of the next operation of the user, wherein the server is used for generating the guiding information of the next operation of the user according to the target operation guiding information and sending the guiding information of the next operation of the user to the mobile terminal.
In some of these embodiments, the method may further comprise:
and the mobile terminal determines whether the intelligent picture identification model library and the navigation strategy package need to be updated to the server according to the version information of the target application program, the operation flow information and the version information of the intelligent picture identification model library and the navigation strategy package which are currently downloaded in the mobile terminal.
Through the steps, the embodiment of the disclosure is based on the image detection and classification algorithm in machine learning, the operation interface where the current user is located is identified through artificial intelligence, and different voices are used for operation guidance according to the preset guidance strategy and different operation purposes of the user. According to the embodiment of the disclosure, the operator can package the low-code arranging operation path, filling prompt words and the like into the instruction policy package, and the operation instruction policy package is issued in real time by means of the channel between the mobile terminal and the server, so that the user can operate the mobile phone to finish a specific operation target just like using navigation when people drive on the road, and the user can operate the mobile phone with voice guidance while rapidly finishing the appointed operation. The map navigation support on-line navigation and off-line navigation, and the embodiment of the disclosure also supports on-line guidance and off-line guidance, so that scenes of different users are met.
The embodiments of the present application are described and illustrated below by means of preferred embodiments.
The intelligent guidance in the mobile terminal APP is conducted by means of an intelligent terminal framework, a picture intelligent recognition model library and a navigation strategy package which are issued, operation guidance and prompting are conducted, the specific flow is shown in fig. 3, and the method specifically comprises the following steps:
step S301, recording a video stream;
step S302, intercepting a picture frame;
step S303, intelligent identification of picture frames;
step S304, judging whether the identification result is empty; if yes, returning to execute the step S301; if not, executing step S305;
step S305, obtaining a navigation strategy;
step S306, judging whether the guiding strategy is empty; if yes, returning to execute the step S301; if not, executing step S307;
step S307, playing a file strategy or playing audio; the process returns to step S301.
The user experience flow at the mobile terminal side can be as shown in fig. 4, and the operation navigation strategy from page 1 to page 4 is specifically as follows:
1) Downloading and loading a specific operation flow navigation strategy package;
2) When the user arrives at the initial interface, playing operation voice, such as 'please click on the page 2 entry';
3) If the user clicks into the page 5 or the page 6 through misoperation, playing the please return to the page 1;
4) If the user operates correctly, entering the page 2, playing "please click on the page 3 entry";
5) If the user fails to operate on the page 2 and clicks into the page 7 or the page 8, playing the "please return to the page 2"
6) If the user operates correctly, page 3 is entered but the target entry is not the first screen, play "please scroll down screen";
7) If the user scrolls to page 3, revealing an entry, play please click on page 4 entry;
8) If the user operates correctly, the user enters the page 4, namely the operation navigation is completed, which is equivalent to the arrival of the vehicle navigation at the destination.
The embodiment of the disclosure adopts mobile terminal side intelligence, and the terminal side intelligence is for the artificial intelligence of high in the clouds following advantage specifically:
1) The features are rich, including fine granularity behavior data, high-frequency acquisition data and user privacy data;
2) The real-time calculation is performed, the operation time consumption is low, and the real-time intervention is performed;
3) The expansion and deployment are convenient, and the development is rapid;
4) Resources are saved, end-side calculation is realized, service calculation power is saved, and offline self-service is realized.
According to the intelligent operation navigation method provided by the embodiment of the disclosure, the current position of the user or the operation stage is known intelligently by means of a machine learning algorithm, and the user is guided to perform the next operation through voice through strategies arranged in a navigation strategy package; the embodiment of the disclosure can solve the problem of mobile terminals, support offline state, have very high response real-time, and can complete the appointed operation as fast as people use map navigation.
The embodiment of the disclosure is particularly suitable for scenes with complex operation flow and great business importance, such as business handling scenes of finance, securities, insurance and the like, various information registration of enterprises and public institutions, business handling scenes and the like. Product flow introduction scenes, such as insurance sales scenes, in a mobile terminal need to be combined with steps operated by a user to carry out some necessary and deep explanation.
It should be noted that the steps illustrated in the above-described flow or flow diagrams of the figures may be performed in a computer system, such as a set of computer-executable instructions, and that, although a logical order is illustrated in the flow diagrams, in some cases, the steps illustrated or described may be performed in an order other than that illustrated herein.
The exemplary embodiments of the present disclosure further provide an operation guiding device of a mobile terminal, which is used to implement the foregoing embodiments and preferred embodiments, and are not described in detail. As used below, the terms "module," "unit," "sub-unit," and the like may be a combination of software and/or hardware that implements a predetermined function. While the means described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.
Fig. 5 shows a schematic block diagram of an operation guide apparatus of a mobile terminal according to an exemplary embodiment of the present disclosure, as shown in fig. 5, the apparatus including:
a first obtaining unit 51, configured to obtain a page where a current operation of the mobile terminal is located by a user;
an identifying unit 52, configured to identify a target type tag corresponding to a page where the current operation is located;
a second obtaining unit 53, configured to obtain target operation guiding information corresponding to the target type tag, where the target operation guiding information is used to indicate a subsequent operation that needs to be performed by a user;
and an output unit 54 for outputting guidance information of a next operation of the user based on the target operation guidance information.
In some of these embodiments, the identification unit 52 includes:
the processing module is used for inputting the page where the current operation is located into a trained intelligent image recognition model library to obtain the target type label corresponding to the page where the current operation is located, wherein the intelligent image recognition model library is used for indicating the corresponding relation between the page and the type label of the page.
In some of these embodiments, the second obtaining unit 53 includes:
the query module is used for querying target operation guiding information corresponding to the target type label from a navigation strategy packet, wherein the navigation strategy packet is stored with: the method comprises the steps of page type labels, operation guide information and corresponding relation between the page type labels and the operation guide information.
In some of these embodiments, the apparatus further comprises:
a judging unit configured to judge whether or not a next operation performed by a user is correct after the guiding information of the next operation of the user is output according to the target operation guiding information;
the first determining unit is configured to determine the next operation as the current operation if the next operation performed by the user is correct, and perform the step of acquiring a page where the current operation of the user on the mobile terminal is located;
and the return unit is used for outputting the guide information of the page where the current operation is returned by the user if the operation of the next operation performed by the user is wrong.
In some of these embodiments, the output unit 54 includes:
the playing module is used for broadcasting the guiding information of the next operation of the user in a voice mode according to the target operation guiding information; or alternatively
And the marking module is used for marking the operation area of the next operation on the page where the current operation is located according to the target operation guiding information.
In some of these embodiments, the output unit 54 includes:
the first output module is used for generating the guiding information of the next operation of the user according to the target operation guiding information and outputting the guiding information of the next operation of the user after the target operation guiding information is acquired from the server; or alternatively
And the second output module is used for outputting the guiding information of the next operation of the user by the mobile terminal after acquiring the guiding information of the next operation of the user from the server, wherein the server is used for generating the guiding information of the next operation of the user according to the target operation guiding information and sending the guiding information of the next operation of the user to the mobile terminal.
In some of these embodiments, the apparatus further comprises:
the second determining unit is used for determining whether the intelligent picture identification model library and the navigation strategy package need to be updated to the server according to the version information of the target application program, the operation flow information and the version information of the intelligent picture identification model library and the navigation strategy package which are currently downloaded in the mobile terminal.
The above-described respective modules may be functional modules or program modules, and may be implemented by software or hardware. For modules implemented in hardware, the various modules described above may be located in the same processor; or the above modules may be located in different processors in any combination.
The exemplary embodiments of the present disclosure also provide an electronic device including: at least one processor; and a memory communicatively coupled to the at least one processor. The memory stores a computer program executable by the at least one processor for causing the electronic device to perform a method according to embodiments of the present disclosure when executed by the at least one processor.
The present disclosure also provides a non-transitory computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor of a computer, is for causing the computer to perform a method according to an embodiment of the present disclosure.
The present disclosure also provides a computer program product comprising a computer program, wherein the computer program, when executed by a processor of a computer, is for causing the computer to perform a method according to embodiments of the disclosure.
Referring to fig. 6, a block diagram of an electronic device 600 that may be a server or a client of the present disclosure, which is an example of a hardware device that may be applied to aspects of the present disclosure, will now be described. Electronic devices are intended to represent various forms of digital electronic computer devices, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 6, the electronic device 600 includes a computing unit 601 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 602 or a computer program loaded from a storage unit 608 into a Random Access Memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the device 600 may also be stored. The computing unit 601, ROM 602, and RAM 603 are connected to each other by a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
A number of components in the electronic device 600 are connected to the I/O interface 605, including: an input unit 606, an output unit 607, a storage unit 608, and a communication unit 609. The input unit 606 may be any type of device capable of inputting information to the electronic device 600, and the input unit 606 may receive input numeric or character information and generate key signal inputs related to user settings and/or function controls of the electronic device. The output unit 607 may be any type of device capable of presenting information and may include, but is not limited to, a display, speakers, video/audio output terminals, vibrators, and/or printers. Storage unit 608 may include, but is not limited to, magnetic disks, optical disks. The communication unit 609 allows the electronic device 600 to exchange information/data with other devices through a computer network, such as the internet, and/or various telecommunications networks, and may include, but is not limited to, modems, network cards, infrared communication devices, wireless communication transceivers and/or chipsets, such as bluetooth devices, wiFi devices, wiMax devices, cellular communication devices, and/or the like.
The computing unit 601 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 601 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 601 performs the various methods and processes described above. For example, in some embodiments, the method of operation guidance of a mobile terminal may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as the storage unit 608. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 600 via the ROM 602 and/or the communication unit 609. In some embodiments, the computing unit 601 may be configured to perform the operation-directing method of the mobile terminal by any other suitable means (e.g. by means of firmware).
Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
As used in this disclosure, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

Claims (10)

1. An operation guidance method of a mobile terminal, comprising:
acquiring a page where a current operation of a user on a mobile terminal is located;
identifying a target type tag corresponding to a page where the current operation is located;
acquiring target operation guide information corresponding to the target type tag, wherein the target operation guide information is used for indicating subsequent operations required to be executed by a user;
and outputting the guiding information of the next operation of the user according to the target operation guiding information.
2. The operation guidance method of the mobile terminal according to claim 1, wherein the identifying a target type tag corresponding to a page on which the current operation is located comprises:
inputting the page where the current operation is located into a trained intelligent image recognition model library to obtain the target type label corresponding to the page where the current operation is located, wherein the intelligent image recognition model library is used for indicating the corresponding relation between the page and the type label of the page.
3. The operation guidance method of a mobile terminal of claim 1, wherein the acquiring the target operation guidance information corresponding to the target type tag comprises:
inquiring target operation guiding information corresponding to the target type label from a navigation strategy packet, wherein the navigation strategy packet is stored with: the method comprises the steps of page type labels, operation guide information and corresponding relation between the page type labels and the operation guide information.
4. The operation guidance method of a mobile terminal of claim 1, further comprising, after the outputting of the guidance information for the next operation of the user according to the target operation guidance information:
judging whether the next operation executed by the user is correct;
if the next operation executed by the user is correct, determining the next operation as the current operation, and executing the step of acquiring the page where the current operation of the user on the mobile terminal is located;
and if the next operation performed by the user is wrong, outputting the guide information of the page where the current operation is returned by the user.
5. The operation guidance method of a mobile terminal of claim 1, wherein outputting guidance information of a next operation of a user according to the target operation guidance information comprises:
according to the target operation guiding information, broadcasting guiding information of the next operation of the user in a voice mode; or alternatively
Marking the operation area of the next operation on the page where the current operation is located according to the target operation guiding information.
6. The operation guidance method of a mobile terminal of claim 1, wherein outputting guidance information of a next operation of a user according to the target operation guidance information comprises:
after the target operation guide information is obtained from the server, the mobile terminal generates guide information of next operation of the user according to the target operation guide information, and outputs the guide information of next operation of the user; or alternatively
After the guiding information of the next operation of the user is obtained from the server, the mobile terminal outputs the guiding information of the next operation of the user, wherein the server is used for generating the guiding information of the next operation of the user according to the target operation guiding information and sending the guiding information of the next operation of the user to the mobile terminal.
7. The operation guidance method of a mobile terminal according to claim 1, further comprising:
and the mobile terminal determines whether the intelligent picture identification model library and the navigation strategy package need to be updated to the server according to the version information of the target application program, the operation flow information and the version information of the intelligent picture identification model library and the navigation strategy package which are currently downloaded in the mobile terminal.
8. An operation guide apparatus of a mobile terminal, comprising:
the first acquisition unit is used for acquiring a page where a current operation of the mobile terminal is located;
the identification unit is used for identifying a target type label corresponding to the page where the current operation is located;
a second obtaining unit, configured to obtain target operation guiding information corresponding to the target type tag, where the target operation guiding information is used to indicate a subsequent operation that needs to be performed by a user;
and the output unit is used for outputting the guiding information of the next operation of the user according to the target operation guiding information.
9. An electronic device, comprising:
a processor; and
a memory in which a program is stored,
wherein the program comprises instructions which, when executed by the processor, cause the processor to perform the operation guidance method of a mobile terminal according to any one of claims 1-7.
10. A non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform the operation guidance method of the mobile terminal according to any one of claims 1 to 7.
CN202310134380.7A 2023-02-09 2023-02-09 Operation guiding method and device of mobile terminal and electronic equipment Pending CN116107680A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310134380.7A CN116107680A (en) 2023-02-09 2023-02-09 Operation guiding method and device of mobile terminal and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310134380.7A CN116107680A (en) 2023-02-09 2023-02-09 Operation guiding method and device of mobile terminal and electronic equipment

Publications (1)

Publication Number Publication Date
CN116107680A true CN116107680A (en) 2023-05-12

Family

ID=86259632

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310134380.7A Pending CN116107680A (en) 2023-02-09 2023-02-09 Operation guiding method and device of mobile terminal and electronic equipment

Country Status (1)

Country Link
CN (1) CN116107680A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117311892A (en) * 2023-11-30 2023-12-29 深圳富士伟业科技有限公司 Remote assistance method, system, electronic device and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117311892A (en) * 2023-11-30 2023-12-29 深圳富士伟业科技有限公司 Remote assistance method, system, electronic device and storage medium
CN117311892B (en) * 2023-11-30 2024-03-08 深圳富士伟业科技有限公司 Remote assistance method, system, electronic device and storage medium

Similar Documents

Publication Publication Date Title
CN110046021B (en) Page display method, device, system, equipment and storage medium
US10382370B1 (en) Automated service agents
US10768947B2 (en) Method for interface refresh synchronization,terminal device, and non-transitory computer-readable storage medium
CN112631910A (en) Front-end testing method and device, computer equipment and storage medium
EP4131083A2 (en) Method and apparatus for generating federated learning model
CN110908922A (en) Application program testing method and device
CN116107680A (en) Operation guiding method and device of mobile terminal and electronic equipment
CN110837334B (en) Method, device, terminal and storage medium for interactive control
CN108665769B (en) Network teaching method and device based on convolutional neural network
US11676593B2 (en) Training an artificial intelligence of a voice response system based on non_verbal feedback
CN113378855A (en) Method for processing multitask, related device and computer program product
US20180247316A1 (en) Sales Support Computer Program, Sales Support Application Program, Sales Support System, and Control Method Therefor
US20230144326A1 (en) Contextual smart switching via multi-modal learning mechanism
CN115797660A (en) Image detection method, image detection device, electronic equipment and storage medium
CN114449327A (en) Video clip sharing method and device, electronic equipment and readable storage medium
CN114445682A (en) Method, device, electronic equipment, storage medium and product for training model
CN113627534A (en) Method and device for identifying type of dynamic image and electronic equipment
CN113850072A (en) Text emotion analysis method, emotion analysis model training method, device, equipment and medium
CN113505268A (en) Interactive processing method and device
CN113051381A (en) Information quality inspection method, device, computer system and computer readable storage medium
CN112927017A (en) Control method, device and system for outbound marketing process
KR102326419B1 (en) Kiosk for data processing and data processing method using the same
CN115185800A (en) Interface analysis optimization method, system, electronic equipment and storage medium
CN113642469A (en) Lip motion detection method, device, equipment and storage medium
CN111292736A (en) Information processing method, system, electronic device, and computer-readable medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination