CN114312816A - Man-machine interaction method and system for moving travel tool - Google Patents
Man-machine interaction method and system for moving travel tool Download PDFInfo
- Publication number
- CN114312816A CN114312816A CN202210001439.0A CN202210001439A CN114312816A CN 114312816 A CN114312816 A CN 114312816A CN 202210001439 A CN202210001439 A CN 202210001439A CN 114312816 A CN114312816 A CN 114312816A
- Authority
- CN
- China
- Prior art keywords
- ambience
- field
- external environment
- environment state
- state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 230000003993 interaction Effects 0.000 title claims abstract description 42
- 230000001105 regulatory effect Effects 0.000 claims abstract description 4
- 230000008569 process Effects 0.000 claims description 15
- 230000008451 emotion Effects 0.000 claims description 13
- 238000012545 processing Methods 0.000 claims description 12
- 238000004458 analytical method Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 4
- 230000003749 cleanliness Effects 0.000 claims description 3
- 230000007613 environmental effect Effects 0.000 description 54
- 230000002996 emotional effect Effects 0.000 description 14
- 238000010586 diagram Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 8
- 230000008859 change Effects 0.000 description 7
- 239000011159 matrix material Substances 0.000 description 5
- 230000006399 behavior Effects 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 230000002349 favourable effect Effects 0.000 description 4
- 230000002411 adverse Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 206010020400 Hostility Diseases 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000001965 increasing effect Effects 0.000 description 2
- 230000036651 mood Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000004378 air conditioning Methods 0.000 description 1
- 230000037007 arousal Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000005684 electric field Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000013178 mathematical model Methods 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000007935 neutral effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 210000000056 organ Anatomy 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 230000036962 time dependent Effects 0.000 description 1
- 238000010792 warming Methods 0.000 description 1
Images
Abstract
The invention relates to a man-machine interaction method and system for moving a travel tool. The method comprises the following steps: s110: acquiring external environment information and internal environment information of the mobile trip tool; s120: analyzing the influence weight of the external environment information on the external environment state of the mobile trip tool and the influence weight of the internal environment information on the internal environment state of the mobile trip tool, and further obtaining the external environment state and the internal environment state; s130: analyzing influence weights of the external environment state and the internal environment state on an ambience field of the mobile travel tool respectively, and further identifying the ambience field; and S140: and regulating the running operation of the mobile travel tool to be adapted to the ambience field according to the identification result of the ambience field.
Description
Technical Field
The invention relates to the technical field of information, in particular to a man-machine interaction method and a man-machine interaction system for moving travel tools, especially automobiles.
Background
In recent years, with the development of the automobile industry in the direction of electric drive, intellectualization and the like, automobiles are gradually changing from mechanical equipment to highly digitalized and informationized intelligent terminals. People's demand for automobile intellectualization is higher and higher, and especially, the human-computer interaction ability of automobiles also gets more and more attention.
However, current automotive human-computer interaction is generally passive, i.e., the on-board system can only perform tasks mechanically according to instructions issued by the user through voice or gestures, and cannot implement active services. This kind of interaction mode is imperfect, and there is a deficiency in the user experience.
Disclosure of Invention
The present invention has been made to solve the above-mentioned problems, and/or other disadvantages, of the prior art.
According to an aspect of the present invention, there is provided a human-computer interaction method for moving a travel tool, including the steps of: s110: acquiring external environment information and internal environment information of the mobile trip tool; s120: analyzing the influence weight of the external environment information on the external environment state of the mobile trip tool and the influence weight of the internal environment information on the internal environment state of the mobile trip tool, and further obtaining the external environment state and the internal environment state; s130: analyzing influence weights of the external environment state and the internal environment state on an ambience field of the mobile travel tool respectively, and further identifying the ambience field; and S140: and regulating the running operation of the mobile travel tool to be adapted to the ambience field according to the identification result of the ambience field.
According to an exemplary configuration, in step S120 and/or step S130, the respective impact weights may be calculated by a fuzzy analytic hierarchy process.
According to an exemplary configuration, in step S120 and/or step S130, the analyzed influence weight may be further dynamically adjusted according to the acquired external environment information and internal environment information.
According to an exemplary configuration, in step S130, the ambience field may be calculated according to the analyzed influence weights of the external environment state and the internal environment state on the ambience field, respectively, and by using a fuzzy inference system including expert rules.
According to one exemplary configuration, the external environmental information may include weather, road conditions, vehicle distance, and sounds outside the vehicle, and the internal environmental information may include temperature inside the vehicle, sounds inside the vehicle, cleanliness inside the vehicle, and smell inside the vehicle.
According to one exemplary configuration, the external environmental state and the internal environmental state may be described using an APA emotion space model.
According to one exemplary configuration, the ambience field may be a three-dimensional spatially blurred ambience field having three coordinate axes representing the three attributes of the ambience field "friendly-hostile", "active-calm" and "formal-casual", respectively.
Another aspect of the present invention provides a human-computer interaction system for moving a travel tool, including: an acquisition unit configured to acquire external environment information and internal environment information of the mobile travel tool; a first analysis processing unit configured to analyze an influence weight of the external environment information on an external environment state of the mobile trip tool and an influence weight of the internal environment information on an internal environment state of the mobile trip tool, and further derive the external environment state and the internal environment state; a second analysis processing unit configured to analyze influence weights of the external environment state and the internal environment state on an ambience field of the mobile travel tool, respectively, and further identify the ambience field; and the control execution unit is configured to regulate and control the running operation of the mobile travel tool to be adapted to the ambience field according to the identification result of the ambience field.
Yet another aspect of the present invention provides a computer readable storage medium having stored thereon a computer program comprising executable instructions which, when executed by a processor, implement a method according to any one of the configurations described above.
Yet another aspect of the present invention provides an electronic device, including: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute the executable instructions to implement a method according to any of the configurations described above.
In the man-machine interaction method and the man-machine interaction system, the internal and external environment states of the mobile trip tool are analyzed by actively acquiring the external environment information and the internal environment information of the mobile trip tool, and the atmosphere field of the mobile trip tool is identified according to the internal and external environment states. Then, the mobile travel tool can actively and optimally regulate and control the operation according to the atmosphere field, so that a favorable atmosphere or an unfavorable atmosphere in the mobile travel tool is created or enhanced, and the user is helped to achieve the effects of pleasure, mind and body or relieving negative emotions. The intelligent emotion interaction capacity of the mobile trip tool is greatly improved, the user experience is improved, and the use adhesion degree of the user to the mobile trip tool can be enhanced.
Drawings
The invention is described in detail below by way of non-limiting examples with reference to the accompanying drawings, which are schematic only and not necessarily to scale, and which show only those parts which are necessary in order to elucidate the invention, while other parts may be omitted or merely mentioned briefly. That is, the present invention may include other components or elements in addition to those shown in the drawings. In the drawings:
FIG. 1 is a schematic flow diagram of a human-computer interaction method according to one embodiment of the invention;
FIG. 2 is a schematic diagram of a three-dimensional spatial blurring ambience field involved in a human-computer interaction method according to one embodiment of the present invention;
FIG. 3 is a multi-target hierarchical structure diagram established when a fuzzy analytic hierarchy process is employed in a human-computer interaction method according to an embodiment of the present invention;
FIG. 4 is a diagram of an APA emotion space model involved in a human-computer interaction method according to one embodiment of the present invention;
FIG. 5 is a flow diagram of a conversion function involved in a human-computer interaction method from an APA emotional state to a fuzzy ambience field according to one embodiment of the present invention;
FIG. 6 is a schematic block diagram of a human-computer interaction system in accordance with one embodiment of the present invention;
FIG. 7 is a schematic block diagram of an electronic device in accordance with one embodiment of the present invention.
Detailed Description
Exemplary embodiments according to the present invention are described in detail below with reference to the accompanying drawings. In the following description, numerous specific details are set forth in order to provide a more thorough understanding of the present invention to those skilled in the art. It will be apparent, however, to one skilled in the art that the present invention may be practiced without some of these specific details. Furthermore, it should be understood that the invention is not limited to the specific embodiments described. Rather, it is contemplated that the invention may be practiced with any combination of the features and elements described herein, whether or not they relate to different embodiments. Thus, the following aspects, features, embodiments and advantages are merely illustrative and should not be considered elements or limitations of the claims except where explicitly recited in a claim.
With the development of the intelligence of the automobile, the functionality of the automobile is increasingly expanded, and more time and more activities are possibly carried out in the automobile. Based on this, it is thought that the atmosphere inside and outside the automobile will have an increasing influence on the passengers and will be increasingly emphasized. Good car atmosphere can make people's mind and body joyful, the stretching is relaxed, and bad atmosphere can make people's mood low or vexation. For example, in the case of a traffic jam before the vehicle is called and the vehicle is not whistling, such an atmosphere can easily cause a fussy mood or even road rage behavior for the driver and passenger in the vehicle. And if someone beside the vehicle can sooth the emotion of the driver and passengers at the moment, unnecessary traffic disputes can be avoided. The starting point of the present invention is derived from the above findings: if the automobile can actively sense or recognize the atmosphere of the automobile in time and correspondingly take some running operations to take the role of a pacifier, the automobile becomes an intelligent partner with emotion interaction capability, and the user experience is greatly improved. Starting from this, and expanding on, a human-computer interaction method and system according to the present invention are conceived and described in detail below.
Referring now to FIG. 1, a flowchart of a human-computer interaction method for moving a travel tool is shown, according to one embodiment of the present invention. Hereinafter, a car will be explained as a typical example of the travel tool. However, the present invention is not limited thereto, but may be applied to various travel tools including various types of vehicles, aircrafts, and ships.
As shown in fig. 1, in a possible implementation manner, the human-computer interaction method of the present invention may include a step S110 of acquiring external environment information and internal environment information of an automobile, a step S120 of analyzing an influence weight of the external environment information on an external environment state of the automobile and an influence weight of the internal environment information on an internal environment state of the automobile and further deriving the external environment state and the internal environment state, a step S130 of analyzing an influence weight of each of the external environment state and the internal environment state on an ambience field of the automobile and further identifying the ambience field, and a step S140 of regulating and controlling an operation of the automobile to be adapted to the ambience field according to a recognition result of the ambience field.
The basis of the human-computer interaction method according to the invention is to sense or recognize the ambience of the car. The atmosphere of the automobile is considered to be psychological factors and psychological feelings which are diffused in the internal space of the automobile and a certain range of external space around the internal space and can influence the behavior process and the result of automobile drivers. However, an atmosphere is abstract and fuzzy, can be perceived but is difficult to define and evaluate accurately, and tends to change dynamically over time. It is easy to understand that the emotional state of the rider himself and environmental factors inside and outside the vehicle affect the atmosphere of the vehicle.
Due to the uncertainty and ambiguity of the atmosphere, the atmosphere of the automobile can be defined as a fuzzy atmosphere field by referring to related research results, which is a combination of the atmosphere and the field, occupies space and has certain energy as traditional electric fields and magnetic fields, the energy cannot be seen and is only sensed by the inner heart of people, and the process and the result of the emotional state of the driver and the behavior of the driver in the atmosphere field of the automobile are influenced to a certain extent. As shown in fig. 2, such a fuzzy ambience field can be described and recognized, for example, by a three-dimensional spatial model having three coordinate axes representing the three attributes of the ambience field, namely "friendly (friendly) -hostile (hot)", "active (level) -quiet (cam)", and "formal (format) -casual (vehicular)". The ambience of any state can be represented by a linear combination of the above three sets of properties of the fuzzy ambience field. The ambient field state of the blurred ambient field three-dimensional space may be represented as:
FA＝(afriendly,alively,acasual)
wherein FA is the real-time state of the fuzzy atmosphere field (FA (t), FA (t-1) and FA (t +1) in FIG. 2 represent the state of the fuzzy atmosphere field at time t, time t-1 and time t +1, respectively), afriendly、alivelyAnd acasualAre values on three coordinate axes (i.e., "friendly-hostile," "active-calm," and "formal-casual") of the three-dimensional space of the ambiance field. When the values of the three coordinate axes are 1, the extreme friendly, the extreme active and the extreme random are represented respectively; when the values of the three coordinate axes are-1, the extreme hostility, the extreme calmness and the extreme formality are represented respectively, and the value of the coordinate origin of the fuzzy atmosphere field represents a neutral state. The three-dimensional fuzzy atmosphere field provides a feasible choice for solving and representing the automobile atmosphere field by using a mathematical model.
As described above, the emotional state of the occupant and environmental factors inside and outside the vehicle affect the atmosphere of the vehicle. Considering that a car often has only one person driving and eventually wants the car to provide emotional feedback to the driver himself, the invention only concerns the influence of the car environment on the car atmosphere. For this, in step S110, external environment information and internal environment information of the automobile are acquired. In the present invention, the external environment information includes, but is not limited to, weather, road conditions (such as traffic jam conditions, pedestrian conditions, adjacent vehicle driving conditions), vehicle distance, sounds outside the vehicle, etc., and the internal environment information includes, but is not limited to, temperature inside the vehicle, sounds inside the vehicle, cleanliness inside the vehicle, smell inside the vehicle, etc. In theory, any information about the environment that may affect the car atmosphere can be acquired as the influencing factor for identifying the car atmosphere. The external and internal environmental information can be directly obtained from a proper position by the automobile or obtained by processing related indirect data. For example, the weather information may be directly obtained by the vehicle from a networked cloud server (e.g., directly obtain whether the weather is "sunny", "cloudy", or "rainfall", etc.), and/or may be indirectly inferred by processing sensed data of vehicle-mounted sensors (e.g., a rain sensor, a light sensor, a thermometer, etc.) (e.g., when the rain sensor does not detect rainfall, the light sensor detects sufficient sunlight, and the thermometer senses that the outside air temperature is high, the vehicle-mounted ECU may determine that the weather condition is "sunny" and store the weather condition in a suitable location, and then obtain the weather information from the location). Accordingly, it is easily understood by those skilled in the art that the external environmental information and the internal environmental information of the car may be directly or indirectly acquired through a camera, a radar, a recording device, and various sensors or measuring instruments mounted on the car and/or other devices networked with the car.
After the external environmental information and the internal environmental information of the automobile are acquired, the external environmental state and the internal environmental state of the automobile are analyzed and evaluated in step S120. Among the acquired environmental information, various pieces of information may have different influences on the respective environmental states. Therefore, it is necessary to obtain the influence weight of each item of external environment information on the external environment state and the influence weight of each item of internal environment information on the internal environment state.
For the calculation of the impact weights, for example, a fuzzy analytic hierarchy process may be used. The fuzzy analytic hierarchy process applies fuzzy theory to analytic hierarchy process, has unique superiority in multi-target optimization sequencing and wide application. In order to facilitate understanding of how to calculate the influence weight of each item of environmental information on the corresponding environmental state by using the fuzzy analytic hierarchy process, a multi-target hierarchical structure diagram shown in fig. 3 may be established first. Wherein, weather F1, road condition F2 and vehicle distance F3 are examples of the external environment information, and are all factors that affect the external environment state of the automobile; taking the in-vehicle temperature F4 and the in-vehicle sound F5 as examples of the internal environment information, they are factors that affect the internal environment state of the automobile. The environmental information together form an influence factor layer in the multi-target hierarchical structure, the external environmental state S1 and the internal environmental state S2 of the automobile form an environmental state layer, and the ambient field a of the automobile is a target layer. When the influence weight of the environmental information is calculated by applying the fuzzy analytic hierarchy process, the method mainly comprises the following steps according to the general principle of the fuzzy analytic hierarchy process: 1) constructing a priority relation matrix of an influencing factor layer relative to an environmental state layer based on 0.1-0.9 scale through questionnaire survey and/or by combining expert opinions; 2) reconstructing the priority relation matrix into a fuzzy consistent matrix; 3) influence weights (W1, W2, W3) of various items of external environment information (weather F1, road condition F2, and vehicle distance F3) on the external environment state S1 (where W1+ W2+ W3 is 1), and influence weights (W4, W5) of various items of internal environment information (vehicle interior temperature F4 and vehicle interior sound F5) on the internal environment state S2 (where W4+ W5 is 1) are calculated from the fuzzy consensus matrix.
After the above-mentioned influence weights are calculated, the external environmental status S1 and the internal environmental status S2 of the vehicle are derived in combination with the corresponding environmental information, for example, by means of an appropriate artificial intelligence model (e.g., expert rules, i.e., a set of rules formulated by experience provided by one or more experts and/or by statistically conducting a large number of questionnaires).
The environmental influence can act on organs such as vision, touch, taste and the like of a human, and a series of psychological reactions are generated after the physiological influences are transmitted to the brain through human nerves, so that the emotional state of the human and the process and the result of the behavior of the human can be influenced. Due to the complexity of the environment, different people may also have different feelings about the same environment. In one embodiment, the external context state S1 and the internal context state S2 may be described, for example, by an APA (Affinity-plus-Arousal) emotion space model. FIG. 4 shows a schematic diagram of an APA emotional space model, which like the fuzzy ambience field described above is also a three-dimensional space with three axes representing Affinity (Affinity), Pleasure (Pleasure) and vitality (Arousal). The APA emotion space model can be expressed as:
E＝(eaffinity,epleasure,earousal)
wherein E is the environmental emotional state (E (t), E (t-1) and E (t +1) in FIG. 4 represent the environmental emotional state at time t, time t-1 and time t + 1, respectively), Eaffinity、epleasureAnd earousalThe values on the three coordinate axes of the APA emotion three-dimensional space are all between-1 and 1. Therefore, the APA emotional space model reflects the psychological/emotional impact of the vehicle environment on the occupants, and thus describes the external environmental status S1 and the internal environmental status S2 determined by different vehicle internal and external environmental information. For example, when the acquired or sensed external environment information F1, F2, and F3 is clear sky, traffic congestion, and a large distance, respectively, the obtained external environment state described by the APA emotional space model may be a state with high affinity, pleasure, and vitality. When the acquired or sensed internal environment information F4 and F5 are respectively high temperature and loud noise, the obtained internal environment state described by the APA emotional space model may be a state in which the affinity, the pleasure, and the vitality are low.
In step S130, an ambience field of the vehicle is identified from the external environment state S1 and the internal environment state S2 of the vehicle. The external environmental state and the internal environmental state of the automobile may have different influences on the atmosphere of the entire automobile in different human senses. Therefore, the influence weights w1 and w2 of the external environment state S1 and the internal environment state S2 on the vehicle atmosphere field (w1+ w2 is 1) are also analyzed, that is, the influence weight of the environment state layer in fig. 3 with respect to the target layer. This can likewise be calculated by constructing a fuzzy consistent matrix of the environmental status layer relative to the target layer using a fuzzy analytic hierarchy process, similar to the way described above in which the respective impact weights of the influencer layer relative to the environmental status layer are found. Incidentally, the analytical calculation of the influence weights W1 to W5 in step S120 and the analytical calculation of the influence weights W1 and W2 in step S130 may be performed sequentially or simultaneously with each other without limitation.
After the influence weight of the external environment state S1 and the internal environment state S2 on the car ambience is calculated, the car ambience can be calculated in combination with the environment states S1 and S2. As described above, the three-dimensional spatial blurring ambience FA of the automobile is a continuous and time-dependent variable. At time t, the state change of the fuzzy ambient field is not only related to the current ambient state, but also to the ambient field state at time t-1. Therefore, the calculation formula of the fuzzy ambience FA can be defined as:
where FA is the state of the fuzzy ambience field and f is the respective ambient state Ei(i-1, …, n) as a function of time t, where EiNamely the states after the external environment state S1 and the internal environment state S2 are described by adopting an APA emotional space model; gamma is a monotone decreasing function which reflects the degree of influence of the ambient field state on the current ambient field state at the moment of T-1, and is more than or equal to 0 and less than or equal to 1, such as an exponential function exp (-kT), wherein T is a sampling period for calculating FA, and k is a positive number reflecting the decay speed of FA (T-1); and lambda is a correlation coefficient which reflects the proportion of the fuzzy atmosphere at the t-1 moment and the fuzzy atmosphere created by the environmental state at the t moment relative to the final fuzzy atmosphere at the t moment, and lambda is more than or equal to 0 and less than or equal to 1. When t is 0, FA is at the origin, i.e., the initial state.
Considering that the contribution degree of each environment state to the fuzzy ambience field is different, a fuzzy logic construction function f can be adopted:
wherein R is a fuzzy inference system mapped from the APA emotion space to FA, which may include a series of expert rules; ei(t) (i ═ 1, …, n) is the fuzzified set of environmental states (here, external environmental state S1 and internal environmental state S2) transformed by the APA emotion-space relationship function; defuzzy is defuzzification, wi(i-1, …, n) is the weight size that each environmental state (here, external environmental state S1 and internal environmental state S2) affects the ambient field, where w1+ w2 is 1. Fig. 5 shows a schematic flow chart of the above-described conversion function f.
By the above exemplary method, the ambience field may be calculated or identified in step S130 according to the external environment state and the internal environment state and their respective influence weights on the vehicle ambience field.
The respective impact weights may be analyzed in steps S120 and S130. However, in an actual scenario, the influence weight of each environmental state and its influence factor on the atmosphere field may change dynamically with time. Therefore, the influence weight can be continuously and dynamically adjusted according to the real-time values of the influence factors (namely, the acquired external environment information and the acquired internal environment information), so that the calculated atmosphere field can more accurately reflect the real-time automobile atmosphere. Such dynamic adjustment may be achieved, for example, by continually performing iterative updates with an appropriate artificial intelligence model. For example, when it is found that a certain influence factor (environmental information) is greatly changed but the finally identified atmosphere field is basically unchanged, the weight of the influence factor can be appropriately adjusted down; alternatively, when a small change is found in a certain influencing factor (environmental information), but the finally identified ambient field has a large change, the weight of the influencing factor can be appropriately increased.
After the ambience field of the vehicle is calculated or identified in step S130, the operating operation of the vehicle can be adjusted to the ambience field in step S140 according to the identification result of the ambience field. Here, "operational operation" of the vehicle means an operation or action performed by a relevant device (e.g., a center control instrument display, a voice device, an air conditioning device) that can be controlled by adjustment in the vehicle, and "adapted to" an atmosphere field means that an operational operation performed by the vehicle can enhance or emphasize a recognized favorable atmosphere or attenuate a recognized unfavorable atmosphere. For example, when it is sensed that the external environment of the automobile is rainy and a traffic jam exists, and the internal environment is a high temperature inside the automobile and an unpleasant smell exists, it is recognized that the automobile has an adverse atmosphere which is more biased toward "hostility", "calmness" and "formal", and accordingly, for example, the automobile can intelligently make humorous voice and/or a commander picture or words can be displayed on the center-controlled display screen, so that the adverse emotion of the driver is relieved, that is, the adverse atmosphere of the automobile is weakened. For another example, when it is recognized that the car has a favorable atmosphere with high "friendly", "active" and "casual" values by sensing the inside and outside environment of the car, the car may automatically play soft and relaxed music, thereby warming or enhancing the favorable atmosphere. If a change in the vehicle's atmosphere over time is detected, the vehicle can automatically adjust its operating operation to the changing atmosphere field to adapt to the change in the atmosphere field. Therefore, the intelligent emotion interaction capacity of the automobile is fully realized, and the user experience is improved.
Corresponding to the man-machine interaction method, the invention also provides a man-machine interaction system. Fig. 6 shows a block diagram of an exemplary configuration of such a human-computer interaction system. The human-computer interaction system may include an acquisition unit 310, a first analysis processing unit 320, a second analysis processing unit 330, a control execution unit 340, and a communication unit 350, which are connected to each other.
The acquisition unit 310 may be configured to acquire external environment information and internal environment information of the automobile. The obtaining unit 310 may obtain the above-mentioned environment information in real time from a corresponding data storage location (e.g., a cloud-side server, an in-vehicle memory, etc.) at a predetermined sampling period via the communication unit 350 connected thereto.
The first analysis processing unit 320 may be configured to analyze the influence weight of the external environmental information on the external environmental state of the automobile and the influence weight of the internal environmental information on the internal environmental state of the automobile through a suitable algorithm (e.g., fuzzy analytic hierarchy process), and then derive the external environmental state and the internal environmental state.
The second analysis processing unit 330 may be configured to analyze, for example, by a fuzzy analytic hierarchy process, influence weights of each of the external environmental state and the internal environmental state on the ambience field of the automobile, and thereby identify the ambience field.
The control execution unit 340 may be configured to send control instructions to appropriate devices on the car to regulate the running operation of the car to adapt to the ambience field according to the recognition result of the ambience field.
The invention also provides a computer-readable storage medium on which a computer program is stored, the program comprising executable instructions which, when executed by a processor for example, may implement the steps of the human-computer interaction method in any of the embodiments described above. In some possible embodiments, aspects of the invention may also be implemented in the form of a program product comprising program code means for causing a terminal device to carry out the steps of the various exemplary embodiments of the human-computer interaction method according to the invention when said program product is run on the terminal device.
The program product for implementing the above method according to the embodiment of the present invention may employ a portable compact disc read only memory (CD-ROM) and include program codes, and may be run on a terminal device, such as a vehicle-mounted computer. However, the program product of the present invention is not limited thereto, and in this context, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
The invention also provides an electronic device that may include a processor and a memory to store executable instructions for the processor. Wherein the processor is configured to perform the steps of the human-computer interaction method in any of the above embodiments via execution of the executable instructions.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
An electronic device 500 according to this embodiment of the invention is described below with reference to fig. 7. The electronic device 500 shown in fig. 7 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 7, the electronic device 500 may be embodied in the form of a general purpose computing device (e.g., an in-vehicle high performance computer). The components of the electronic device 500 may include, but are not limited to: at least one processing unit or processor 410, at least one storage unit or memory 420, a bus (not shown) connecting the various system components including the memory 420 and the processor 410, and the like.
Wherein the memory 420 stores program code, which is executable by the processor 410 to cause the processor 410 to perform the steps of various exemplary embodiments of the human-computer interaction method according to the present invention. For example, processor 410 may perform the various steps shown in FIG. 1.
Memory 420 may include readable media in the form of volatile memory units, such as random access memory units (RAM) and/or cache memory units, and may further include read-only memory units (ROM). Memory 420 may also include a program/utility having a set (at least one) of program modules including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
The electronic device 500 may communicate with one or more external devices 600 (e.g., cloud-side servers, various in-vehicle and out-of-vehicle sensors, car networking devices, etc.). Such communication may be performed through various communication interfaces 430 (e.g., a mobile network port, a WIFI port, a CAN port, an ethernet port, etc.) provided on the electronic device 500.
It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 500, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiment of the present invention can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be an on-board computer, a server, or a network device, etc.) to execute the human-computer interaction method according to the embodiment of the present invention.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
Claims (10)
1. A man-machine interaction method for moving a travel tool comprises the following steps:
s110: acquiring external environment information and internal environment information of the mobile trip tool;
s120: analyzing the influence weight of the external environment information on the external environment state of the mobile trip tool and the influence weight of the internal environment information on the internal environment state of the mobile trip tool, and further obtaining the external environment state and the internal environment state;
s130: analyzing influence weights of the external environment state and the internal environment state on an ambience field of the mobile travel tool respectively, and further identifying the ambience field; and
s140: and regulating the running operation of the mobile travel tool to be adapted to the ambience field according to the identification result of the ambience field.
2. The human-computer interaction method according to claim 1, wherein in step S120 and/or step S130, the corresponding influence weight is calculated by fuzzy analytic hierarchy process.
3. A human-computer interaction method according to claim 1 or 2, wherein in step S120 and/or step S130, the analyzed influence weight is dynamically adjusted according to the acquired external environment information and internal environment information.
4. The human-computer interaction method according to any one of claims 1 to 3, wherein in step S130, the ambience field is calculated according to the analyzed influence weight of each of the external environment state and the internal environment state on the ambience field and by using a fuzzy inference system including expert rules.
5. The human-computer interaction method according to any one of claims 1 to 4, wherein the external environment information comprises weather, road conditions, distance between vehicles, sounds outside vehicles, and the internal environment information comprises temperature inside vehicles, sounds inside vehicles, cleanliness inside vehicles, and smell inside vehicles.
6. A human-computer interaction method according to any one of claims 1 to 5, wherein the external environment state and the internal environment state are described by using an APA emotion space model.
7. The human-computer interaction method according to any one of claims 1 to 6, wherein the ambience field is a three-dimensional spatially blurred ambience field having three coordinate axes representing three attributes of the ambience field, namely friendly-hostile, active-calm and formal-casual.
8. A human-computer interaction system for moving a travel tool, comprising:
an acquisition unit (310) configured to acquire external environment information and internal environment information of the mobile travel tool;
a first analysis processing unit (320) configured to analyze an influence weight of the external environment information on an external environment state of the mobile trip tool and an influence weight of the internal environment information on an internal environment state of the mobile trip tool, and further derive the external environment state and the internal environment state;
a second analysis processing unit (330) configured to analyze influence weights of the external environment state and the internal environment state on an ambience field of the mobile travel tool, respectively, and further to identify the ambience field; and
a control execution unit (340) configured to regulate the running operation of the mobile travel tool to adapt to the ambience field according to the identification result of the ambience field.
9. A computer-readable storage medium, on which a computer program is stored, the computer program comprising executable instructions that, when executed by a processor, carry out the method according to any one of claims 1 to 7.
10. An electronic device (500), characterized by comprising:
a processor (410); and
a memory (420) for storing executable instructions of the processor;
wherein the processor is configured to execute the executable instructions to implement the method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210001439.0A CN114312816A (en) | 2022-01-04 | 2022-01-04 | Man-machine interaction method and system for moving travel tool |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210001439.0A CN114312816A (en) | 2022-01-04 | 2022-01-04 | Man-machine interaction method and system for moving travel tool |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114312816A true CN114312816A (en) | 2022-04-12 |
Family
ID=81022728
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210001439.0A Pending CN114312816A (en) | 2022-01-04 | 2022-01-04 | Man-machine interaction method and system for moving travel tool |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114312816A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106845391A (en) * | 2017-01-18 | 2017-06-13 | 中国地质大学（武汉） | Atmosphere recognition methods and identifying system under a kind of domestic environment |
| CN106874939A (en) * | 2017-01-18 | 2017-06-20 | 中国地质大学（武汉） | The atmosphere recognition methods of the view-based access control model information under domestic environment and identifying system |
| CN109152166A (en) * | 2018-07-31 | 2019-01-04 | 中国地质大学（武汉） | A kind of household atmosphere field control method based on signal light control |
| CN113291321A (en) * | 2021-06-16 | 2021-08-24 | 苏州智加科技有限公司 | Vehicle track prediction method, device, equipment and storage medium |
| CN113780062A (en) * | 2021-07-26 | 2021-12-10 | 岚图汽车科技有限公司 | Vehicle-mounted intelligent interaction method based on emotion recognition, storage medium and chip |
-
2022
- 2022-01-04 CN CN202210001439.0A patent/CN114312816A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106845391A (en) * | 2017-01-18 | 2017-06-13 | 中国地质大学（武汉） | Atmosphere recognition methods and identifying system under a kind of domestic environment |
| CN106874939A (en) * | 2017-01-18 | 2017-06-20 | 中国地质大学（武汉） | The atmosphere recognition methods of the view-based access control model information under domestic environment and identifying system |
| CN109152166A (en) * | 2018-07-31 | 2019-01-04 | 中国地质大学（武汉） | A kind of household atmosphere field control method based on signal light control |
| CN113291321A (en) * | 2021-06-16 | 2021-08-24 | 苏州智加科技有限公司 | Vehicle track prediction method, device, equipment and storage medium |
| CN113780062A (en) * | 2021-07-26 | 2021-12-10 | 岚图汽车科技有限公司 | Vehicle-mounted intelligent interaction method based on emotion recognition, storage medium and chip |
Non-Patent Citations (1)
| Title |
|---|
| 许伦辉;曹宇超;林培群;: "基于多影响因素RDMA~*算法的无人驾驶动态路径规划", 交通信息与安全, no. 02, 28 June 2020 (2020-06-28) * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3482344B1 (en) | Portable personalization | |
| CN108725136B (en) | Vehicle-mounted air conditioner adjusting method, system, equipment and storage medium | |
| CN104340144B (en) | More vehicle settings | |
| US10430695B2 (en) | System and method for contextualized vehicle operation determination | |
| US11292477B2 (en) | Vehicle manipulation using cognitive state engineering | |
| CN104816687B (en) | The system and method for automation driver's action in vehicle | |
| CN111305695B (en) | Method and device for controlling a vehicle | |
| CN111572549A (en) | Driving environment adjusting method and system, storage medium and electronic equipment | |
| CN113496510A (en) | Realistic image perspective transformation using neural networks | |
| WO2021185468A1 (en) | Technique for providing a user-adapted service to a user | |
| CN111797755A (en) | Automobile passenger emotion recognition method and electronic equipment | |
| US11794676B1 (en) | Computing systems and methods for generating user-specific automated vehicle actions using artificial intelligence | |
| CN114312816A (en) | Man-machine interaction method and system for moving travel tool | |
| US20230211744A1 (en) | Technique for providing a user-adapted service to a user | |
| Lim et al. | Temporal early exiting with confidence calibration for driver identification based on driving sensing data | |
| CN107531249B (en) | Method and device for detecting a change in the behaviour of a driver of a motor vehicle | |
| US11620475B2 (en) | Domain translation network for performing image translation | |
| CN113791841A (en) | Execution instruction determining method, device, equipment and storage medium | |
| CN113805698A (en) | Execution instruction determining method, device, equipment and storage medium | |
| Crispim-Junior et al. | AutoExp: A multidisciplinary, multi-sensor framework to evaluate human activities in self-driving cars | |
| US20240157896A1 (en) | Vehicle system and method for adjusting interior control settings based on driver emotion and environmental context | |
| Wu et al. | Towards Human-Vehicle Interaction: Driving Risk Analysis Under Different Driver Vigilance States and Driving Risk Detection Method | |
| Fasanmade et al. | Context-aware driver distraction severity classification using lstm network | |
| CN113515060B (en) | Control script processing method and device, electronic equipment and storage medium | |
| US20240112562A1 (en) | Systems and methods for increasing the safety of voice conversations between drivers and remote parties |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |