CN115858080A - Method, device, equipment and storage medium for designing human-computer interaction interface - Google Patents

Method, device, equipment and storage medium for designing human-computer interaction interface Download PDF

Info

Publication number
CN115858080A
CN115858080A CN202211671081.9A CN202211671081A CN115858080A CN 115858080 A CN115858080 A CN 115858080A CN 202211671081 A CN202211671081 A CN 202211671081A CN 115858080 A CN115858080 A CN 115858080A
Authority
CN
China
Prior art keywords
human
designing
task
interaction interface
structure model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211671081.9A
Other languages
Chinese (zh)
Inventor
谭珂
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guodian Investment Guangdong Comprehensive Intelligent Energy Innovation Research Institute Co ltd
Original Assignee
Guodian Investment Guangdong Comprehensive Intelligent Energy Innovation Research Institute Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guodian Investment Guangdong Comprehensive Intelligent Energy Innovation Research Institute Co ltd filed Critical Guodian Investment Guangdong Comprehensive Intelligent Energy Innovation Research Institute Co ltd
Priority to CN202211671081.9A priority Critical patent/CN115858080A/en
Publication of CN115858080A publication Critical patent/CN115858080A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The application relates to the technical field of computers, and discloses a method, a device, equipment and a storage medium for designing a human-computer interaction interface. The method comprises the following steps: constructing a task structure model according to task flow logic; performing characteristic analysis on each key task node by combining a human error database; optimizing the task structure model according to the analysis result; and designing a human-computer interaction interface according to the optimized task structure model. And performing characteristic analysis on the key task nodes through a human error database. And optimizing the task structure model according to the analysis result, and designing an interactive interface according to the optimized task structure model. The reason that each key task node is easy to cause errors is introduced, the task structure model is optimized by combining the reason, and the finally designed interface is more consistent with the cognition of an operator. The safety and the reliability of the nuclear power station human-computer interaction system are improved, and the human error rate of operators of the nuclear power station is reduced.

Description

Method, device, equipment and storage medium for designing human-computer interaction interface
Technical Field
The present application relates to the field of computer technologies, and for example, to a method, an apparatus, a device, and a storage medium for designing a human-computer interaction interface.
Background
Under the rapid development situation of the current computer technology and informatization technology, the nuclear power station control system at home and abroad is rapidly developed from a traditional analog control interactive interface to a digital human-computer interactive interface. When designing a human-computer interaction interface, the consistency of the implementation steps, the presentation forms and the psychological models of operators needs to be considered, so that the interaction interface can more effectively convey information. If the mismatching of the above aspects exists, the cognitive friction problem is easy to generate, and the decision-making mistake is generated. Thereby greatly influencing the final decision of the operator and causing serious accidents. Such as a nuclear leak accident, due to operator error. As can be seen from the analysis of accidents of 400 nuclear power stations in the world, nearly 70% of accidents are related to human errors. The key causes behind the human errors include the design of a human-computer interaction interface which is unscientific and reasonable.
Specifically, the reasons for the error include the design of digital information codes and man-machine interaction of complex information systems. In the field of information visual representation work of human-computer interfaces, the mental and mental loads of complex information system operators are influenced by information coding modes, function block layouts, information presentation modes and the like, and further the operation and control operation are influenced. Therefore, how to optimally design a complex interactive interface and improve the consistency of the selection of an operator and the mind of the operator is a problem to be solved at present.
It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present application and therefore may include information that does not constitute prior art known to a person of ordinary skill in the art.
Disclosure of Invention
The following presents a simplified summary in order to provide a basic understanding of some aspects of the disclosed embodiments. This summary is not an extensive overview nor is intended to identify key/critical elements or to delineate the scope of such embodiments but rather as a prelude to the more detailed description that is presented later.
The embodiment of the disclosure provides a method, a device, equipment and a storage medium for designing a human-computer interaction interface, which can improve the safety and reliability of a nuclear power station human-computer interaction system and reduce the human error rate of operators in a nuclear power station.
In some embodiments, a method for designing a human-machine-interaction interface, comprises: constructing a task structure model according to task flow logic; the task structure model comprises a plurality of key task nodes; performing characteristic analysis on each key task node by combining a human error database; optimizing the task structure model according to the analysis result; and designing a human-computer interaction interface according to the optimized task structure model.
Optionally, the performing feature analysis on each mission-critical node includes: analyzing the expression of the key task node, and/or; the operator's cognition is analyzed.
Optionally, the optimizing the task structure model includes: optimizing the expression of the key task nodes, and/or; and optimizing the logic sequence between the key task nodes and the nodes connected with the key task nodes.
Optionally, the designing a human-computer interaction interface according to the optimized task structure model includes: designing an information architecture and an interaction framework of a human-computer interaction interface; designing an information icon; the information icon comprises an icon, a control and a navigation component; and designing color coding.
Optionally, after optimizing the task structure model, the method for designing a human-computer interaction interface further includes: and inputting unlocking information of the user through the multi-mode function.
Optionally, the entering of the unlocking information of the user through the multi-modal function includes: displaying key task nodes which can be controlled through multi-mode functions to a user; receiving a key task node selected by a user; collecting multi-mode information of a user, and establishing a corresponding relation with a key task node selected by the user; and recording the corresponding relation into the optimized task structure model.
Optionally, the acquiring multimodal information of the user includes: collecting gesture interaction actions of a user, and/or; collecting voice of a user, and/or; the eye movement track of the user is collected.
In some embodiments, an apparatus for designing a human-machine interface comprises: a processor and a memory storing program instructions, the processor being configured, when executing the program instructions, to perform a method for designing a human-machine-interaction interface as in any one of the above embodiments.
In some embodiments, the apparatus comprises a body, further comprising: the device for designing a human-computer interaction interface according to the above embodiment is disposed in the body.
In some embodiments, the storage medium has stored therein program instructions that, when executed, perform a method for designing a human-machine-interaction interface as in any one of the above embodiments.
The method, the device, the equipment and the storage medium for designing the human-computer interaction interface provided by the embodiment of the disclosure can realize the following technical effects:
when the human-computer interaction interface is designed, each key task node is subjected to feature analysis through the human error database, so that the reason of human errors occurring before a certain task node is known. And optimizing the task structure model according to the analysis result, and finally designing a human-computer interaction interface according to the optimized task structure model. Compared with a related interface design method, the method introduces the reason that each key task node is easy to cause errors, modifies the task structure model by combining the reason, and finally designs the human-computer interaction interface which is more consistent with the cognition of an operator. The safety and the reliability of the nuclear power station human-computer interaction system are improved, the human error rate of operators of the nuclear power station is reduced, and meanwhile the enterprise image can be improved.
The foregoing general description and the following description are exemplary and explanatory only and are not restrictive of the application.
Drawings
One or more embodiments are illustrated by way of example in the accompanying drawings, which correspond to the accompanying drawings and not in limitation thereof, in which elements having the same reference numeral designations are shown as like elements and not in limitation thereof, and wherein:
FIG. 1 is a schematic diagram of a method for designing a human-machine interface provided by an embodiment of the disclosure;
FIG. 2 is a schematic diagram of another method for designing a human-machine interface provided by an embodiment of the disclosure;
FIG. 3 is a schematic diagram of another method for designing a human-machine interface provided by an embodiment of the disclosure;
FIG. 4 is a schematic structural diagram of an apparatus for designing a human-computer interaction interface according to an embodiment of the present disclosure.
Detailed Description
So that the manner in which the features and elements of the disclosed embodiments can be understood in detail, a more particular description of the disclosed embodiments, briefly summarized above, may be had by reference to the embodiments, some of which are illustrated in the appended drawings. In the following description of the technology, for purposes of explanation, numerous details are set forth in order to provide a thorough understanding of the disclosed embodiments. However, one or more embodiments may be practiced without these details. In other instances, well-known structures and devices may be shown in simplified form in order to simplify the drawing.
The terms "first," "second," and the like in the description and in the claims, and the above-described drawings of embodiments of the present disclosure, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It should be understood that the data so used may be interchanged under appropriate circumstances such that embodiments of the present disclosure described herein may be made. Furthermore, the terms "comprising" and "having," as well as any variations thereof, are intended to cover non-exclusive inclusions.
The term "plurality" means two or more unless otherwise specified.
In the embodiment of the present disclosure, the character "/" indicates that the preceding and following objects are in an or relationship. For example, A/B represents: a or B.
The term "and/or" is an associative relationship that describes objects, meaning that three relationships may exist. For example, a and/or B, represents: a or B, or A and B.
The term "correspond" may refer to an association or binding relationship, and a corresponds to B refers to an association or binding relationship between a and B.
Under the rapid development situation of the current computer technology and informatization technology, the nuclear power station control system at home and abroad is rapidly developed from a traditional analog control interactive interface to a digital human-computer interactive interface. When designing a human-computer interaction interface, the consistency of the implementation steps, the presentation forms and the psychological models of operators needs to be considered, so that the interaction interface can more effectively convey information. If the mismatching of the above aspects exists, the cognitive friction problem is easy to generate, and the decision-making mistake is generated. Therefore, the final decision of the operator is greatly influenced, and a great accident occurs. Such as a nuclear leak accident, due to operator error. As can be seen from the analysis of accidents of more than 400 nuclear power stations in the world, nearly 70% of accidents are related to human errors. The key causes behind the human errors include the design of a human-computer interaction interface which is unscientific and reasonable.
Specifically, the reasons for the error include the design of digital information codes and man-machine interaction of complex information systems. In the field of information visual representation work of human-computer interfaces, the mental and mental loads of complex information system operators are influenced by information coding modes, function block layouts, information presentation modes and the like, and further the operation and control operation are influenced. The following problems also exist in the design aspect at present:
firstly, the work of the related factors and the related mechanisms between the visual representation method of the information in the human-computer interface of the complex information system and human errors is lacked. Human errors are the vital factors influencing the safety of a nuclear power control system, a human-computer interface is used as a carrier for information circulation between a complex information system and an operator, and the work of the correlation effect between the complex information system and the operator is directly related to the safety and the reliability of the nuclear power system.
And secondly, the traceability work of an association mechanism between interface design and human errors aiming at the nuclear power station control system is lacked. The existing work lacks the theoretical work achievement related to the information visual coding and the high-efficiency information presentation of the digital display and control system of the nuclear power station. The reasonable information coding mode and the information presenting mode are beneficial to improving the identification degree, the comprehensibility degree and the predictive degree of the information elements in the nuclear power control system.
Therefore, how to optimally design a complex interactive interface and improve the consistency of the selection of an operator and the mind of the operator is a problem to be solved at present.
Based on the method, the method for designing the human-computer interaction interface is provided, so that the safety and the reliability of the nuclear power plant human-computer interaction system can be improved, and the human-caused error rate of operators of the nuclear power plant can be reduced.
As shown in fig. 1, the method for designing a human-computer interaction interface includes:
s101, constructing a task structure model according to task flow logic.
And S102, performing characteristic analysis on each key task node by combining the human error database.
And S103, optimizing the task structure model according to the analysis result.
And S104, designing a human-computer interaction interface according to the optimized task structure model.
In this embodiment, a human error database is used to perform feature analysis on each mission-critical node, so as to know the reason of human error occurring before a certain mission node. And optimizing the task structure model according to the analysis result, and finally designing a human-computer interaction interface according to the optimized task structure model. Compared with a related interface design method, the method introduces the reason that each key task node is easy to cause errors, modifies the task structure model by combining the reason, and finally designs the human-computer interaction interface which is more consistent with the cognition of an operator. The safety and the reliability of the nuclear power station human-computer interaction system are improved, the human error rate of operators of the nuclear power station is reduced, and meanwhile the enterprise image can be improved.
It should be noted that the task flow logic refers to all task functions and the jump and logic relationship between the task functions that can be implemented by the nuclear power plant, and in a simple aspect, the jump and logic relationship between all functions and functions that can be implemented by the interactive interface. The human error database stores the case and reason analysis of human operation error for each key task node. And due to data intercommunication with the cloud network platform, updating can be carried out to obtain the latest case data.
Based on the task nodes of the interactive interface, functions such as monitoring, decision making, feedback and the like are established on the basis of cognitive processing results such as information perception, understanding cognition, prediction evaluation and the like, and experience a cognitive progressive process from a low level to a high level. Scattered data elements are 'integrated' into information entities as the cognitive processing process advances. At the beginning of the design of a human-computer interface of a nuclear power station system, task flows based on the interface system need to be combed, a task structure model is built, and features in key task nodes are analyzed.
Optionally, performing feature analysis on each mission-critical node includes: analyzing the expression of the key task nodes, and/or; the operator's cognition is analyzed.
In this embodiment, performing feature analysis on the mission-critical nodes generally includes analyzing whether the representation of the mission-critical nodes is reasonable and/or analyzing the awareness of the operator of the representation. That is, some similar expressions which are easy to make ambiguity should be avoided in the interactive interface. Therefore, the reliability and the safety of the nuclear power station interactive interface are improved.
Optionally, optimizing the task structure model includes: optimizing the expression of the key task nodes, and/or; and optimizing the logic sequence between the mission-critical nodes and the nodes connected with the mission-critical nodes.
In this embodiment, correspondingly, according to the human error database, if a situation with ambiguous expression or a key task node that is likely to affect the cognition of the operator is found, optimization processing should be performed on the key task node.
Optionally, designing a human-computer interaction interface according to the optimized task structure model, including: designing an information architecture and an interaction framework of a human-computer interaction interface; and designing an information icon.
In this embodiment, the information icons include icons, controls, navigation components, and the like. The icons specifically include rules and regulations, semantic communication, knowledge consistency, visual highlighting, and the like. The controls include windows, scroll bars, labels, text boxes, lists, buttons, radio boxes, check boxes, and the like. Color coded designs include background colors, foreground colors, and the like. And after the task structure model is optimized, designing a corresponding human-computer interaction interface according to the model.
Optionally, after the task structure model is optimized, the method further includes: and inputting unlocking information of the user through the multi-mode function.
With reference to fig. 2, another method for designing a human-computer interaction interface provided by the embodiment of the present application is described. The method comprises the following steps:
s201, constructing a task structure model according to task flow logic.
And S202, performing characteristic analysis on each key task node by combining a human error database.
And S203, optimizing the task structure model according to the analysis result.
And S204, inputting unlocking information of the user through the multi-mode function.
And S205, designing a human-computer interaction interface.
In this embodiment, after the task structure model is optimized, unlocking information of the user through the multi-modal function may also be entered. The multi-modal information may include, but is not limited to, eye movement interaction technology, gesture interaction technology, and voice interaction technology. Therefore, the working efficiency of the nuclear power station master control room is improved, and the workload of operators is reduced. In the field of work of objective evaluation methods for usability of human-computer interfaces, eye movement tracking and electroencephalogram technologies become hot spots for students at home and abroad to work, and objective evaluation methods and evaluation systems for usability of human-computer interfaces are developed and matured day by day. The part of work adopts a visual behavior experiment method, an eye movement tracking experiment method and a subjective situation perception evaluation technology to carry out multichannel availability evaluation on the human-computer interface of the improved nuclear power station system. The visual behavior experiment can acquire the error rate of a nuclear power station operator when the operator executes tasks; the eye tracking technology can help analyze the eye movement physiological characteristics induced in the process of executing the task, so that the behavior reaction characteristics of the person in the information acquisition process can be analyzed more accurately.
Optionally, entering user unlocking information through the multimodal function includes: displaying key task nodes which can be controlled through multi-mode functions to a user; receiving a key task node selected by a user; collecting multi-mode information of a user, and establishing a corresponding relation with a key task node selected by the user; and recording the corresponding relation into the optimized task structure model.
Referring to fig. 3, another method for designing a human-computer interaction interface provided by the embodiment of the present application is described. The method comprises the following steps:
s301, displaying the key task nodes which can be controlled through the multi-modal function to the user.
And S302, receiving the key task node selected by the user.
And S303, acquiring multi-modal information of the user, and establishing a corresponding relation with the key task node selected by the user.
And S304, recording the corresponding relation into the optimized task structure model.
In this embodiment, after the task structure model is optimized, unlocking information of the user through the multi-modal function may also be entered. Steps may present the user with mission critical nodes that may be controlled through multimodal functionality. And after a user selects a certain key task node, inputting corresponding multi-mode information. And establishing a corresponding relation between the information and the task nodes and storing the corresponding relation in a task structure model. Further, in use, an operator may control certain functions through multi-modal functions.
Optionally, the method further comprises collecting multimodal information of the user, including: collecting gesture interaction actions of a user, and/or; collecting voice of a user, and/or; the eye movement track of the user is collected.
In the embodiment, through eye movement tracking, an operator can interactively control the nuclear power station control system through head movement and eye movement, so that the working efficiency is improved, and the hands of the operator are liberated. Gesture recognition is realized through a motion tracking technology and an algorithm, and an operator can perform gesture interactive control on a power station control system through gestures, so that the working efficiency is improved; meanwhile, the technology can be applied to operation scenes in which equipment cannot be directly contacted. According to the characteristics of voice recognition, the operation scene of the nuclear power station is combined, an operator can input information through voice and perform voice interaction control on the nuclear power station control system, the working efficiency is improved, and the hands of the operator are liberated.
For example, taking gesture interaction as an example, gesture interaction techniques may be developed for gestures defined by a human hand waving or gestures defined by a finger bending motion. The Eyelink 1000plus desktop type eye tracker is adopted to track eye movement, eye watching information replaces a mouse to track and position a visual target, and task division is performed between eye control interaction and other interaction modes through multi-channel integration so as to solve the problem of the Midas phenomenon generated by a single mode as far as possible by utilizing respective advantages. For example, the target is positioned by eye control, and different gestures are used for assisting the nuclear power plant control room user to perform various fine operations on the target. At this time, the user can position various visual targets by gaze tracking, and perform operations such as "confirm", "open", "close", "zoom in", "zoom out", and the like on the targets with different gestures. On the basis of technologies such as speech recognition and wireless communication for unspecific human voice, the wireless wearable speech interaction device suitable for a nuclear power station control room is designed and developed by improving the speech command recognition rate and researching and developing related core algorithms, online recognition and wireless transmission of unspecific human voice commands are realized, and free and smooth communication between people and a computer is realized from a speech layer. Specifically, firstly, a hardware architecture of the wireless wearable voice interaction device suitable for a nuclear power station control room is designed and realized, and hardware module division, design and realization of the device are completed, so that the developed device can be used without training a user in advance and can be used after being taken up; by using the device to identify the voice command input by the user, the computing performance of the host computer of the computer is thoroughly liberated, and the secondary development complexity of compiling the voice interaction application program is reduced; and the wireless transmission of the identification result of the support device to the host computer supports the free action of a user in the nuclear power plant control room. And secondly, simulating a work analysis nuclear power plant control room user voice interaction flow, emphasizing on input and output related to a work analysis and voice interaction device, determining interaction tasks respectively borne by a user, a developed voice recognition device, a host and a controlled device, standardizing and defining an expression mode of voice commands among the user, the developed device, the host and user application, and designing and realizing a voice interaction interface supporting user customization so as to efficiently support natural and smooth voice command interaction of the user in the nuclear power plant control room.
As shown in fig. 4, an apparatus 400 for designing a human-computer interaction interface according to an embodiment of the present disclosure includes a Processor (Processor) 401 and a Memory (Memory) 402. Optionally, the apparatus may also include a bus 403 and a Communication Interface 404. The processor 401, the memory 402 and the communication interface 404 may communicate with each other through the bus 403. The communication interface 404 may be used for information transfer. The processor 401 may invoke logic instructions in the memory 402 to perform the method for designing a human-machine interface of the above-described embodiments.
Furthermore, the logic instructions in the memory 402 may be implemented in software functional units and stored in a computer readable storage medium when sold or used as a stand-alone product.
The memory 402 is a storage medium and can be used for storing software programs, computer executable programs, such as program instructions/modules corresponding to the methods in the embodiments of the present disclosure. The processor 401 executes functional applications and data processing, i.e. implements the method for designing a human-machine interaction interface in the above-described embodiments, by executing program instructions/modules stored in the memory 402.
The memory 402 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal device, and the like. Further, memory 402 may include high speed random access memory and may also include non-volatile memory.
The disclosed embodiments provide a computer-readable storage medium storing computer-executable instructions configured to perform the above-described method for designing a human-machine interaction interface.
The computer readable storage medium described above may be a transitory computer readable storage medium or a non-transitory computer readable storage medium.
The technical solution of the embodiments of the present disclosure may be embodied in the form of a software product, where the computer software product is stored in a storage medium and includes one or more instructions to enable a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method of the embodiments of the present disclosure. And the aforementioned storage medium may be a non-transitory storage medium comprising: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes, and may also be a transient storage medium.
The above description and drawings sufficiently illustrate embodiments of the disclosure to enable those skilled in the art to practice them. Other embodiments may incorporate structural, logical, electrical, process, and other changes. The examples merely typify possible variations. Individual components and functions are optional unless explicitly required, and the sequence of operations may vary. Portions and features of some embodiments may be included in or substituted for those of others. Furthermore, the words used in the specification are words of description only and are not intended to limit the claims. As used in the description of the embodiments and the claims, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. Similarly, the term "and/or" as used in this application is meant to encompass any and all possible combinations of one or more of the associated listed. Furthermore, the terms "comprises" and/or "comprising," when used in this application, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. Without further limitation, an element defined by the phrase "comprising a" \8230; "does not exclude the presence of additional like elements in a process, method or apparatus comprising the element. In this document, each embodiment may be described with emphasis on differences from other embodiments, and the same and similar parts between the respective embodiments may be referred to each other. For methods, products, etc. of the embodiment disclosures, reference may be made to the description of the method section for relevance if it corresponds to the method section of the embodiment disclosure.
Those of skill in the art would appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software may depend upon the particular application and design constraints imposed on the technical solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments. It can be clearly understood by the skilled person that, for convenience and brevity of description, the specific working processes of the system, the apparatus and the unit described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments disclosed herein, the disclosed methods, products (including but not limited to devices, apparatuses, etc.) may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units may be merely a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form. The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the units can be selected according to actual needs to implement the present embodiment. In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. In the description corresponding to the flowcharts and block diagrams in the figures, operations or steps corresponding to different blocks may also occur in different orders than disclosed in the description, and sometimes there is no specific order between the different operations or steps. For example, two sequential operations or steps may in fact be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. Each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

Claims (10)

1. A method for designing a human-computer interaction interface, comprising:
constructing a task structure model according to task flow logic; the task structure model comprises a plurality of key task nodes;
performing characteristic analysis on each key task node by combining a human error database;
optimizing the task structure model according to the analysis result;
and designing a human-computer interaction interface according to the optimized task structure model.
2. The method for designing a human-computer interaction interface according to claim 1, wherein the performing feature analysis on each mission-critical node comprises:
analyzing the expression of the key task node, and/or;
the operator's cognition is analyzed.
3. A method for designing a human-machine-interaction interface according to claim 2, wherein said optimizing the task structure model comprises:
optimizing the expression of the key task nodes, and/or;
and optimizing the logic sequence between the key task nodes and the nodes connected with the key task nodes.
4. The method for designing a human-computer interaction interface according to claim 1, wherein the designing a human-computer interaction interface according to the optimized task structure model comprises:
designing an information architecture and an interaction framework of a human-computer interaction interface;
designing an information icon; the information icon comprises an icon, a control and a navigation component;
and designing color coding.
5. A method for designing a human-computer interaction interface according to any one of claims 1 to 4, wherein after the task structure model is optimized, the method further comprises:
and inputting unlocking information of the user through the multi-mode function.
6. A method for designing a human-computer interaction interface according to claim 5, wherein said entering of user unlocking information by multimodal functions comprises:
displaying key task nodes which can be controlled through multi-mode functions to a user;
receiving a key task node selected by a user;
collecting multi-mode information of a user, and establishing a corresponding relation with a key task node selected by the user;
and recording the corresponding relation into the optimized task structure model.
7. A method for designing a human-computer interaction interface according to claim 6, wherein said collecting multimodal information of a user comprises:
collecting gesture interaction actions of a user, and/or;
collecting voice of a user, and/or;
the eye movement track of the user is collected.
8. An apparatus for designing a human-machine-interaction interface, comprising a processor and a memory storing program instructions, characterized in that the processor is configured to perform the method for designing a human-machine-interaction interface according to any one of claims 1 to 7 when executing the program instructions.
9. An apparatus comprising a body, further comprising:
an apparatus for designing a human-computer interface as defined in claim 8, disposed within the body.
10. A storage medium storing program instructions, characterized in that said program instructions, when executed, perform a method for designing a human-machine-interaction interface according to any one of claims 1 to 7.
CN202211671081.9A 2022-12-26 2022-12-26 Method, device, equipment and storage medium for designing human-computer interaction interface Pending CN115858080A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211671081.9A CN115858080A (en) 2022-12-26 2022-12-26 Method, device, equipment and storage medium for designing human-computer interaction interface

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211671081.9A CN115858080A (en) 2022-12-26 2022-12-26 Method, device, equipment and storage medium for designing human-computer interaction interface

Publications (1)

Publication Number Publication Date
CN115858080A true CN115858080A (en) 2023-03-28

Family

ID=85654589

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211671081.9A Pending CN115858080A (en) 2022-12-26 2022-12-26 Method, device, equipment and storage medium for designing human-computer interaction interface

Country Status (1)

Country Link
CN (1) CN115858080A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116501437A (en) * 2023-06-30 2023-07-28 之江实验室 Man-machine interaction cognition model construction method and device based on human engineering
CN117651101A (en) * 2024-01-30 2024-03-05 南京功夫豆信息科技有限公司 User operation service management system and method
CN118034692A (en) * 2024-04-03 2024-05-14 武昌首义学院 Method and system for optimizing three-dimensional simulation data warehouse interactive interface of satellite data

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116501437A (en) * 2023-06-30 2023-07-28 之江实验室 Man-machine interaction cognition model construction method and device based on human engineering
CN116501437B (en) * 2023-06-30 2023-09-22 之江实验室 Man-machine interaction cognition model construction method and device based on human engineering
CN117651101A (en) * 2024-01-30 2024-03-05 南京功夫豆信息科技有限公司 User operation service management system and method
CN117651101B (en) * 2024-01-30 2024-04-05 南京功夫豆信息科技有限公司 User operation service management system and method
CN118034692A (en) * 2024-04-03 2024-05-14 武昌首义学院 Method and system for optimizing three-dimensional simulation data warehouse interactive interface of satellite data
CN118034692B (en) * 2024-04-03 2024-07-05 武昌首义学院 Method and system for optimizing three-dimensional simulation data warehouse interactive interface of satellite data

Similar Documents

Publication Publication Date Title
Xi et al. The rise and potential of large language model based agents: A survey
CN115858080A (en) Method, device, equipment and storage medium for designing human-computer interaction interface
CN107291867B (en) Dialog processing method, device and equipment based on artificial intelligence and computer readable storage medium
CN107463601B (en) Dialog understanding system construction method, device and equipment based on artificial intelligence and computer readable storage medium
Chao Human-computer interaction: process and principles of human-computer interface design
Subramonyam et al. Protoai: Model-informed prototyping for ai-powered interfaces
Pauchet et al. Gazeform: dynamic gaze-adaptive touch surface for eyes-free interaction in airliner cockpits
Lu et al. Exploring spatial UI transition mechanisms with head-worn augmented reality
Khan et al. A mechanism for blind-friendly user interface adaptation of mobile apps: A case study for improving the user experience of the blind people
Malode Benchmarking public large language model
Avgerou et al. A review of the methodologies movement
Flanders Building otherwise
Di Pasquale et al. A taxonomy of factors influencing worker's performance in human–robot collaboration
Gratch et al. Exploring the implications of virtual human research for human-robot teams
CN117608552A (en) GUI-oriented task automatic execution plug-in generation method and service acquisition method
Hammond et al. Dialogue design: Characteristics of user knowledge
Woods et al. Requirements for Adaptive User Interfaces for Industrial Maintenance Procedures: A discussion of context, requirements and research opportunities
Alvarez-Cortes et al. Current challenges and applications for adaptive user interfaces
Shaikh et al. Comprehensive understanding of intelligent user interfaces
Jiang Computational Representations for Graphical User Interfaces
Zaguia et al. Using multimodal fusion in accessing web services
Brown et al. Design of multimodal mobile interfaces
Schaffer Modeling modality selection in multimodal human-computer interaction: extending automated usability evaluation tools for multimodal input
CN111562838A (en) Safety platform for point-to-point brain sensing
Fagan Explanation, Multiple Perspectives, and Understanding

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination