CN113220183A - System operation method and device, computer equipment and readable storage medium - Google Patents
System operation method and device, computer equipment and readable storage medium Download PDFInfo
- Publication number
- CN113220183A CN113220183A CN202110563753.3A CN202110563753A CN113220183A CN 113220183 A CN113220183 A CN 113220183A CN 202110563753 A CN202110563753 A CN 202110563753A CN 113220183 A CN113220183 A CN 113220183A
- Authority
- CN
- China
- Prior art keywords
- icon
- system operation
- cursor
- operation method
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 95
- 210000001747 pupil Anatomy 0.000 claims abstract description 24
- 230000006870 function Effects 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 16
- 238000013528 artificial neural network Methods 0.000 claims description 13
- 230000004913 activation Effects 0.000 claims description 9
- 238000012549 training Methods 0.000 claims description 7
- 238000012795 verification Methods 0.000 claims description 7
- 230000003213 activating effect Effects 0.000 claims description 6
- 238000003064 k means clustering Methods 0.000 claims description 3
- 238000005553 drilling Methods 0.000 claims description 2
- 238000011017 operating method Methods 0.000 claims 6
- 238000013473 artificial intelligence Methods 0.000 abstract description 3
- 230000002349 favourable effect Effects 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 12
- 230000008569 process Effects 0.000 description 9
- 238000012545 processing Methods 0.000 description 7
- 230000002068 genetic effect Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 210000004243 sweat Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04812—Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/12—Computing arrangements based on biological models using genetic models
- G06N3/126—Evolutionary algorithms, e.g. genetic algorithms or genetic programming
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Biophysics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Human Computer Interaction (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Evolutionary Biology (AREA)
- Software Systems (AREA)
- Mathematical Physics (AREA)
- Artificial Intelligence (AREA)
- Biomedical Technology (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Genetics & Genomics (AREA)
- Physiology (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention provides a system operation method, a system operation device, computer equipment and a readable storage medium, which can be used in the field of artificial intelligence or other fields, wherein the method comprises the following steps: capturing the current eye-fixation position of the eye pupil of the user on a display screen; generating a cursor at the watching position, and synchronously moving the cursor and the watching position; and when the cursor stops moving on the display screen and is superposed with the icon, running the application program corresponding to the icon. The scheme can operate the operation of the application program through the eye pupils, and is favorable for improving the diversity and convenience of functional operation.
Description
Technical Field
The present invention relates to a system operation method, apparatus, computer device and readable storage medium. It should be noted that the system operation method, the apparatus, the computer device and the readable storage medium of the present invention may be used in the field of artificial intelligence, and may also be used in any fields other than the field of artificial intelligence.
Background
When the existing online banking system is used, the function is single, and the user groups who click or are inconvenient to operate, such as residual sweat stains or other liquid on hands and the personnel who lack fingers, cannot operate and use, and the operation convenience is poor.
Disclosure of Invention
The embodiment of the invention provides a system operation method, which aims to solve the technical problems of single function and poor convenience in system operation in the prior art. The method comprises the following steps:
capturing the current eye-fixation position of the eye pupil of the user on a display screen;
generating a cursor at the watching position, and synchronously moving the cursor and the watching position;
and when the cursor stops moving on the display screen and is superposed with the icon, running the application program corresponding to the icon.
The embodiment of the invention also provides a system operation device, which is used for solving the technical problems of single function and poor convenience in system operation in the prior art. The device includes:
the eye fixation position capturing module is used for capturing the current eye fixation position of the eye pupil of the user on the display screen;
the display module is used for generating a cursor on the watching position, and the cursor moves synchronously with the watching position;
and the operation module is used for running the application program corresponding to the icon when the cursor stops moving on the display screen and is overlapped with the icon.
The embodiment of the invention also provides computer equipment which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the processor realizes the arbitrary system operation method when executing the computer program so as to solve the technical problems of single function and poor convenience in system operation in the prior art.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program for executing any system operation method is stored in the computer-readable storage medium, so as to solve the technical problems of single function and poor convenience in system operation in the prior art.
In the embodiment of the invention, the method comprises the steps of capturing the current eye-fixation position of the eye pupil of a user on a display screen; generating a cursor at the watching position, and synchronously moving the cursor and the watching position; and when the cursor stops moving on the display screen and is superposed with the icon, running the application program corresponding to the icon. The application program corresponding to the icon is operated according to the superposition condition of the cursor and the icon, and then the operation of the application program corresponding to the icon can be automatically and intelligently finished when a user watches the icon through the eye pupil; in addition, the mode of finishing the application program corresponding to the running icon by watching the icon through the eye pupil avoids directly touching the screen, and the loss or damage of the terminal where the system is located is reduced.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the principles of the invention. In the drawings:
FIG. 1 is a flow chart of a method of operation of a system according to an embodiment of the present invention;
fig. 2 is a flowchart of an application program corresponding to an operation icon according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an online banking system according to an embodiment of the present invention;
FIG. 4 is a block diagram of a computer device according to an embodiment of the present invention;
fig. 5 is a block diagram of a system operating device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail with reference to the following embodiments and accompanying drawings. The exemplary embodiments and descriptions of the present invention are provided to explain the present invention, but not to limit the present invention.
In an embodiment of the present invention, a method for operating a system is provided, as shown in fig. 1, the method includes:
step 102: capturing the current eye-fixation position of the eye pupil of the user on a display screen;
step 104: generating a cursor at the watching position, and synchronously moving the cursor and the watching position;
step 106: and when the cursor stops moving on the display screen and is superposed with the icon, running the application program corresponding to the icon.
As can be seen from the process shown in fig. 1, in the embodiment of the present invention, it is proposed to capture the current gaze position of the eye pupil of the user on the display screen; generating a cursor at the watching position, and synchronously moving the cursor and the watching position; and when the cursor stops moving on the display screen and is superposed with the icon, running the application program corresponding to the icon. The application program corresponding to the icon is operated according to the superposition condition of the cursor and the icon, and then the operation of the application program corresponding to the icon can be automatically and intelligently finished when a user watches the icon through the eye pupil; in addition, the mode of finishing the application program corresponding to the running icon by watching the icon through the eye pupil avoids directly touching the screen, and the loss or damage of the terminal where the system is located is reduced.
In specific implementation, the system operation method may be executed on any terminal used by a user, for example, a front-end terminal of a service system, a mobile terminal, a home appliance terminal with a display screen, and the like.
In specific implementation, the system operation method can be used for completing the operation of any application program.
In specific implementation, in order to be able to accurately run an application program according to the gaze position of the pupil of the eye of the user, in this embodiment, as shown in fig. 2, a process of running the application program corresponding to the icon when the cursor stops moving on the display screen and coincides with the icon is implemented by the following steps:
when the cursor stops moving on the display screen and coincides with an icon for a preset time length, changing the display mode of the icon;
and when the cursor is overlapped with the icon after the display mode is changed for the preset time length, running the application program corresponding to the icon, otherwise (for example, the cursor is not overlapped with the icon after the display mode is changed, or the cursor is not overlapped with the icon after the display mode is changed for the preset time length, namely the eye pupil of the user moves away from the icon), not running the application program corresponding to the icon and recovering the display mode of the icon.
Specifically, the display mode of the icon may be changed to be a display mode in which the icon is more prominent, for example, the icon is displayed in an enlarged manner (for example, in the fast mode for young people, the ratio of the enlarged icon to the filled picture except the icon to the entire display screen may be 1: 5, and in the old mode, the ratio of the enlarged icon to the filled picture except the icon to the entire display screen may be 2: 1), the icon is displayed in the middle, or the icon is displayed in the middle after being enlarged.
Specifically, in order to adapt to the habits of different people in operation, the preset duration may be different for different user values of different age groups, and the old, the middle aged and the young correspond to the preset durations with different values, for example, 0.1 to 0.5s, 1 to 5s, and the like. The preset time length can be obtained by performing K-means clustering according to the historical operation time lengths of the user groups of different age groups.
In specific implementation, in order to implement processes such as login operation of an application program based on the system operation method, in this embodiment, the method further includes:
during login, a login account and a login password can be sent for verification, wherein the login account comprises user basic information and pupil data; specifically, the basic user information may include an identity card number, a bound mobile phone number, a bound bank card number, a user's real name, and the like, so that the background can verify the login.
And after the verification is passed, running the application program corresponding to the icon.
In specific implementation, in order to meet different operation choices of a user, in this embodiment, an activation icon may be set on the display screen, and the function of the system operation method is activated by operating the activation icon.
Specifically, the user may activate the function of the system operation method by operating the activation icon, and may not activate the function of the system operation method even when the user operates the activation icon, that is, the user uses manual operation.
Specifically, the activating icon may be operated by any manner such as clicking, voice controlling, shaking, and the like.
In specific implementation, in order to help a user smoothly and correctly use the system operation method, in this embodiment, a guidance manner is further provided, for example, when the function of the system operation method is activated for the first time, a virtual login page is generated, and an operation video drill is performed based on the virtual login page, that is, an operation process is shown and taught by operating a video;
the cursor is moved to the live-action drill icon, the simulated operation page (for example, the business handling page and the like) guides the user to train the use of the cursor, namely, the user is guided to move the eye pupil to train the cursor to move, and then the user is guided to operate the icon which is required to be operated by moving the cursor, for example, the user is informed to move the eye pupil to the watching position on the display screen through the graphic representation or voice, so that the aim of training the moving cursor is achieved, and the cursor is superposed with the icon to operate the icon.
In specific implementation, in order to further improve the convenience of the system operation method, in this embodiment, a method for directly setting the system operation method as the system operation method, that is, a system operation mode is set, and a user can directly perform an operation through the system operation each time without restarting the system operation method each time. For example, for each system, when the number of times of using the system operation method reaches a preset value, inputting basic information of a user and the frequency of using the system operation method into a prediction model, and outputting whether to directly use the system operation method or not by the prediction model, wherein the prediction model is obtained by training a GA-BP neural network structure by taking historical user data as a sample; if the output of the prediction model directly uses the system operation method, the system operation method is set to be a system operation mode, otherwise, the system operation method is not set to be the system operation mode, and whether the system operation method is operated or not is determined according to whether information for activating the system operation method is received or not, namely, a user selects a manual operation mode or selects whether the system operation method is operated or not.
Specifically, the GA-BP neural network structure is established through a BP neural network and a genetic algorithm, and the genetic algorithm is introduced in the aspect of optimizing the weight and the threshold of the BP neural network to construct the GA-BP neural network structure. Determining a GA-BP neural network structure, determining the BP neural network structure according to the number of network input and output, and further determining the number of parameters needing to be optimized in a genetic algorithm. According to the kolmogorov principle, one three-layer BP neural network can sufficiently complete any mapping from n dimension to m dimension, generally only one hidden layer is needed, and the number of hidden layer nodes is determined by a trial and error method, so that the GA-BP neural network structure is determined. And (4) training and learning the BP neural network by taking the optimal individual output by the genetic algorithm as the initial weight and the threshold of the BP neural network. The method comprises the steps of taking collected historical user data (such as basic information of users such as age, occupation and gender, information such as the number of times of logging in a system and the frequency of using the system operation method) as historical data, dividing the historical data into a training set and a testing set, training a GA-BP neural network model based on historical data analysis to obtain a prediction model, and verifying the prediction accuracy of the prediction model by using a testing sample. The prediction model can be continuously self-optimized to the test model by a machine learning method in the using process, so that the effectiveness of the model is improved.
In a specific implementation, the preset value may be a value capable of measuring a user's preference for the system operation method, for example, after the user activates the system operation method, in a case that the user uses the system operation method more than 10 times, the user information may be input into the prediction model, so as to automatically and intelligently adjust the system to be in a manual operation mode or an intelligent operation mode based on the system operation method according to a prediction result.
In specific implementation, when the number of times that the user uses the system operation method is less than 10, according to the ratio of using the system operation method for nearly five times, if the ratio > is 50%, it is described that the user prefers to use the system operation method, and the system operation method is directly set as the operation mode of the system, that is, the system operation method is automatically and directly executed each time the user uses the system.
In specific implementation, the system operation method can be used in any screen-based system operation scenario, such as service handling of a user terminal, service handling of a front-end terminal of a service system, and operation of a home appliance. Taking an online banking system as an example, taking the method for executing the system operation on the mobile communication terminal as an example, as shown in fig. 3, the online banking system includes a firewall, and a mobile banking server is provided with a data information protection wall in the process of exchanging data with the internet, and the internet front end connected in the online banking system is connected with the mobile communication terminal through a WAP gateway and a signal base station.
In this embodiment, a computer device is provided, as shown in fig. 4, and includes a memory 402, a processor 404, and a computer program stored on the memory and executable on the processor, and the processor implements any of the above-mentioned system operation methods when executing the computer program.
In particular, the computer device may be a computer terminal, a server or a similar computing device.
In the present embodiment, there is provided a computer-readable storage medium storing a computer program for executing the system operation method of any of the above.
In particular, computer-readable storage media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer-readable storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable storage medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
Based on the same inventive concept, the embodiment of the present invention further provides a system operation device, as described in the following embodiments. Because the principle of the system operation device for solving the problem is similar to the system operation method, the implementation of the system operation device can refer to the implementation of the system operation method, and repeated details are not repeated. As used hereinafter, the term "unit" or "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 5 is a block diagram showing a configuration of a system operating apparatus according to an embodiment of the present invention, and as shown in fig. 5, the apparatus includes:
a gaze location capture module 502 for capturing a current gaze location of a user's eye pupil on a display screen;
a display module 504, configured to generate a cursor at the gaze position, where the cursor moves synchronously with the gaze position;
an operation module 506, configured to run the application program corresponding to the icon when the cursor stops moving on the display screen and coincides with the icon.
In one embodiment, an operating module includes:
the display setting unit is used for changing the display mode of the icon when the cursor stops moving on the display screen and the time length of the cursor is overlapped with the icon and reaches the preset time length;
and the operation unit is used for running the application program corresponding to the icon when the cursor is overlapped with the icon with the changed display mode to reach the preset duration.
In one embodiment, the preset duration is different for user values of different age groups, and the preset duration is obtained by performing K-means clustering according to operation durations of user groups of different age groups.
In one embodiment, further comprising:
the verification module is used for sending a login account and a login password for verification, wherein the login account comprises user basic information and pupil data;
and the operation module is used for operating the application program corresponding to the icon after the verification is passed.
In one embodiment, further comprising:
and the activation module is used for setting an activation icon on the display screen and activating the function of the system operation method by operating the activation icon.
In one embodiment, further comprising:
the system comprises a guide module, a video processing module and a video processing module, wherein the guide module is used for generating a virtual login page when the function of the system operation method is activated for the first time, and performing operation video drilling based on the virtual login page; and moving the cursor to the live-action drill icon, and simulating the operation to guide the user to use and train the cursor.
In one embodiment, further comprising:
the prediction module is used for inputting the basic information of a user and the frequency of using the system operation method into a prediction model when the using times of the system operation method reach a preset value aiming at each system, and outputting whether the system operation method is directly used or not by the prediction model, wherein the prediction model is obtained by training a GA-BP neural network structure by taking historical user data as a sample;
and the mode setting module is used for setting the system operation method to be the running mode of the system if the output of the prediction model directly uses the system operation method, and otherwise, determining whether to run the system operation method according to whether information for activating the system operation method is received.
The embodiment of the invention realizes the following technical effects: the method comprises the steps of capturing the current eye position of the eye pupil of a user on a display screen; generating a cursor at the watching position, and synchronously moving the cursor and the watching position; and when the cursor stops moving on the display screen and is superposed with the icon, running the application program corresponding to the icon. The application program corresponding to the icon is operated according to the superposition condition of the cursor and the icon, and then the operation of the application program corresponding to the icon can be automatically and intelligently finished when a user watches the icon through the eye pupil; in addition, the mode of finishing the application program corresponding to the running icon by watching the icon through the eye pupil avoids directly touching the screen, and the loss or damage of the terminal where the system is located is reduced.
Although the present invention provides method steps as described in the examples or flowcharts, more or fewer steps may be included based on routine or non-inventive labor. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. When an actual apparatus or client product executes, it may execute sequentially or in parallel (e.g., in the context of parallel processors or multi-threaded processing) according to the embodiments or methods shown in the figures.
As will be appreciated by one skilled in the art, embodiments of the present description may be provided as a method, apparatus (system) or computer program product. Accordingly, embodiments of the present description may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment. In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. The terms "upper", "lower", and the like, indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience in describing the present invention and simplifying the description, but do not indicate or imply that the referred devices or elements must have a specific orientation, be constructed and operated in a specific orientation, and thus, should not be construed as limiting the present invention. Unless expressly stated or limited otherwise, the terms "mounted," "connected," and "connected" are intended to be inclusive and mean, for example, that they may be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations. It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict. The present invention is not limited to any single aspect, nor is it limited to any single embodiment, nor is it limited to any combination and/or permutation of these aspects and/or embodiments. Moreover, each aspect and/or embodiment of the present invention may be utilized alone or in combination with one or more other aspects and/or embodiments thereof.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the present invention, and they should be construed as being included in the following claims and description.
Claims (10)
1. A method of system operation, comprising:
capturing the current eye-fixation position of the eye pupil of the user on a display screen;
generating a cursor at the watching position, and synchronously moving the cursor and the watching position;
and when the cursor stops moving on the display screen and is superposed with the icon, running the application program corresponding to the icon.
2. The system operating method of claim 1, wherein running an application corresponding to an icon when a cursor stops moving on the display screen and coincides with the icon comprises:
when the cursor stops moving on the display screen and coincides with an icon for a preset time length, changing the display mode of the icon;
and when the cursor is overlapped with the icon with the changed display mode to reach the preset duration, operating the application program corresponding to the icon.
3. The system operation method according to claim 2, wherein the preset duration is different for the user values of different age groups, and the preset duration is obtained by K-means clustering according to the operation durations of the user groups of different age groups.
4. The system operating method of any of claims 1 to 3, further comprising:
sending a login account and a login password for verification, wherein the login account comprises user basic information and pupil data;
and after the verification is passed, running the application program corresponding to the icon.
5. The system operating method of any of claims 1 to 3, further comprising:
and setting an activation icon on the display screen, and activating the function of the system operation method by operating the activation icon.
6. The system operating method of any of claims 1 to 3, further comprising:
when the function of the system operation method is activated for the first time, generating a virtual login page, and performing operation video drilling based on the virtual login page;
and moving the cursor to the live-action drill icon, and simulating the operation to guide the user to use and train the cursor.
7. The system operating method of any of claims 1 to 3, further comprising:
for each system, when the using times of the system operation method reach a preset value, inputting basic information of a user and the frequency of using the system operation method into a prediction model, and outputting whether the system operation method is directly used or not by the prediction model, wherein the prediction model is obtained by training a GA-BP neural network structure by taking historical user data as a sample;
and if the output of the prediction model directly uses the system operation method, setting the system operation method as the operation mode of the system, otherwise, determining whether to operate the system operation method according to whether the information for activating the system operation method is received.
8. A system operation apparatus, comprising:
the eye fixation position capturing module is used for capturing the current eye fixation position of the eye pupil of the user on the display screen;
the display module is used for generating a cursor on the watching position, and the cursor moves synchronously with the watching position;
and the operation module is used for running the application program corresponding to the icon when the cursor stops moving on the display screen and is overlapped with the icon.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the system operating method of any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium characterized by storing a computer program for executing the system operation method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110563753.3A CN113220183A (en) | 2021-05-24 | 2021-05-24 | System operation method and device, computer equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110563753.3A CN113220183A (en) | 2021-05-24 | 2021-05-24 | System operation method and device, computer equipment and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113220183A true CN113220183A (en) | 2021-08-06 |
Family
ID=77099300
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110563753.3A Pending CN113220183A (en) | 2021-05-24 | 2021-05-24 | System operation method and device, computer equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113220183A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103336580A (en) * | 2013-07-16 | 2013-10-02 | 卫荣杰 | Cursor control method of head-mounted device |
| US20150020032A1 (en) * | 2012-03-29 | 2015-01-15 | Huawei Device Co., Ltd. | Three-Dimensional Display-Based Cursor Operation Method and Mobile Terminal |
| CN106325480A (en) * | 2015-06-30 | 2017-01-11 | 天津三星电子有限公司 | Line-of-sight tracing-based mouse control device and method |
| CN109992096A (en) * | 2017-12-29 | 2019-07-09 | 北京亮亮视野科技有限公司 | Activate intelligent glasses functional diagram calibration method |
-
2021
- 2021-05-24 CN CN202110563753.3A patent/CN113220183A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150020032A1 (en) * | 2012-03-29 | 2015-01-15 | Huawei Device Co., Ltd. | Three-Dimensional Display-Based Cursor Operation Method and Mobile Terminal |
| CN103336580A (en) * | 2013-07-16 | 2013-10-02 | 卫荣杰 | Cursor control method of head-mounted device |
| CN106325480A (en) * | 2015-06-30 | 2017-01-11 | 天津三星电子有限公司 | Line-of-sight tracing-based mouse control device and method |
| CN109992096A (en) * | 2017-12-29 | 2019-07-09 | 北京亮亮视野科技有限公司 | Activate intelligent glasses functional diagram calibration method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10902321B2 (en) | Neural networking system and methods | |
| US11651702B2 (en) | Systems and methods for prediction of student outcomes and proactive intervention | |
| CN107424019A (en) | The art work based on Emotion identification recommends method, apparatus, medium and electronic equipment | |
| US11443647B2 (en) | Systems and methods for assessment item credit assignment based on predictive modelling | |
| EP3443450A1 (en) | Two-stage training of a spoken dialogue system | |
| CN104270391B (en) | A kind of processing method and processing device of access request | |
| US20210303973A1 (en) | Artificial intelligence-based personalized financial recommendation assistant system and method | |
| US20210398235A1 (en) | Advances in data ingestion and data provisioning to aid management of domain-specific data via software data platform | |
| US11144879B2 (en) | Exploration based cognitive career guidance system | |
| CN109948151A (en) | The method for constructing voice assistant | |
| TWI791176B (en) | Method, system, device and computer program carrier for automatically identifying effective data collection modules | |
| CN110727800A (en) | Self-adaptive preschool education system and method for children | |
| CN110472798A (en) | Prediction technique, device and the computer readable storage medium of time series data | |
| KR20150045974A (en) | Method and apparatus for providing learning contents | |
| CN113220183A (en) | System operation method and device, computer equipment and readable storage medium | |
| CN114760274B (en) | Voice interaction method, device, equipment and storage medium for online classroom | |
| US11024289B2 (en) | Cognitive recommendation engine facilitating interaction between entities | |
| KR102427085B1 (en) | Electronic apparatus for providing education service and method for operation thereof | |
| CN113268512B (en) | Enterprise post professional skill training system based on internet platform | |
| CN107544248A (en) | A kind of task optimization method and apparatus in mobile robot | |
| CN111540358B (en) | Man-machine interaction method, device, equipment and storage medium | |
| CN109446070A (en) | Networking software upgrading test method, apparatus, electronic equipment and storage medium | |
| CN112712798B (en) | Privatization data acquisition method and device | |
| Ortega-Moral et al. | Cloud4all: scope, evolution and challenges | |
| CN105868620A (en) | Information processing method and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210806 |
|
| RJ01 | Rejection of invention patent application after publication |