CN116860196A - System and method for interaction according to noise information, electronic equipment and vehicle - Google Patents
System and method for interaction according to noise information, electronic equipment and vehicle Download PDFInfo
- Publication number
- CN116860196A CN116860196A CN202310684225.2A CN202310684225A CN116860196A CN 116860196 A CN116860196 A CN 116860196A CN 202310684225 A CN202310684225 A CN 202310684225A CN 116860196 A CN116860196 A CN 116860196A
- Authority
- CN
- China
- Prior art keywords
- information
- sound
- module
- scene
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 55
- 238000000034 method Methods 0.000 title claims abstract description 25
- 238000012545 processing Methods 0.000 claims abstract description 50
- 230000000694 effects Effects 0.000 claims abstract description 25
- 238000001914 filtration Methods 0.000 claims abstract description 23
- 230000006870 function Effects 0.000 claims description 25
- 230000009471 action Effects 0.000 claims description 13
- 230000006837 decompression Effects 0.000 claims description 13
- 230000007613 environmental effect Effects 0.000 claims description 12
- 238000012544 monitoring process Methods 0.000 claims description 12
- 230000002860 competitive effect Effects 0.000 claims description 11
- 230000000007 visual effect Effects 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 9
- 230000000386 athletic effect Effects 0.000 claims description 8
- 230000008569 process Effects 0.000 claims description 6
- 230000004630 mental health Effects 0.000 claims description 4
- 238000004519 manufacturing process Methods 0.000 abstract description 3
- 230000001149 cognitive effect Effects 0.000 abstract description 2
- 230000036541 health Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 238000005265 energy consumption Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000003205 fragrance Substances 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000004807 localization Effects 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B7/00—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00
- G08B7/06—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00 using electric transmission, e.g. involving audible and visible signalling through the use of sound and light sources
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mechanical Engineering (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
The application relates to a system, a method, electronic equipment and a vehicle for interaction according to noise information, which comprise a function triggering module, an information feedback module, a scene judging module, a voice module, an information output module and a graphic display module; the scene judging module is used for judging a user use scene; the information feedback module is used for the dynamic effect and information output of the man-machine interaction interface of the central control screen, the vibration positioning information output and the sound effect positioning information output feedback; the information output module is used for outputting the information processed by the information feedback module to the central control screen for carrying out man-machine interaction interface dynamic effect and information output, seat vibration positioning output and sound positioning output; the voice module is used for identifying the position of sound production, filtering sound and processing sound pressure; the graphic display module is used for processing signals through the cabin domain controller; the application adopts multi-mode interaction, increases interestingness, intuitively displays automobile information in a graphical mode, and reduces the cognitive load of users.
Description
Technical Field
The application belongs to the technical field of intelligent interaction of vehicle scenes, and relates to a system, a method, electronic equipment and a vehicle for interaction according to noise information.
Background
Under the intelligent young development situation of automobiles, screens are used as main interaction media, and the man-machine interaction design of screens of market vehicles mainly comprises touch interaction, is not multi-mode interaction and lacks interesting construction.
At present, vehicle information on the market is displayed as single energy consumption such as energy consumption, mileage and the like, and the single energy consumption is calculated and converted into data display which can be checked by a user through a processor. With the development of intelligent cabin software development technology, information graphical visual display can better embody the concept of centering on users.
Along with the improvement of the living standard of people, the health consciousness is improved, the automobile is used as a long-time main transportation means of a user, and the noise monitoring and sound health reminding functions are absent in the automobile.
The publication number CN109672787A provides an intelligent reminding method for equipment, which can automatically set ringing and vibration according to environmental noise and environmental voice, and comprises the following steps: acquiring an environmental sound signal; analyzing the environmental sound signal to obtain voice level information and noise level information; and generating equipment bell sound size information and vibration intensity information according to the noise level information and the voice level information. The application has the beneficial effects that the scene mode is intelligently set by analyzing and judging the environmental noise and the environmental voice, the bell sound size and the vibration intensity are intelligently set, and the user experience is improved.
CN111696561a relates to a voice interaction system and method based on auditory, visual and olfactory feedback. The system comprises a microphone, a sound host, a voice engine, a loudspeaker, a central control screen, atmosphere lamps and a fragrance system; the microphone and the voice host are connected through a wire harness; the sound host and the voice engine are connected by a software interface; the voice engine is connected with the loudspeaker, the central control screen, the atmosphere lamp and the fragrance system through the wire harness. The application can correspond to multiple channels in the aspects of vision, hearing and smell of the driver in the process of voice interaction between the driver and the real vehicle, and creates an interaction mode of ceremony for the user so as to achieve the purpose of improving ceremony and science and technology of the cabin.
CN115158197a provides a vehicle-mounted intelligent cabin entertainment control system based on sound source localization, which is characterized by comprising a detection module, a localization module and a control module: the detection module is used for detecting voice signals; the positioning module is used for receiving the voice signal, positioning the sound source position in the vehicle, identifying the voice signal based on the sound source position and generating corresponding instruction content; the sound source position comprises a main driving position, a secondary driving position, a first rear seat position and a second rear seat position; the instruction content at least comprises vehicle body control and entertainment system control information; the control module is used for controlling a target area screen corresponding to the sound source position according to the sound source position of the voice signal and the instruction content, and displaying a control state.
The above patent has a lower degree of correlation than the present application.
Disclosure of Invention
The application aims to solve the technical problems of lack of noise monitoring and sound health reminding functions in an automobile in the prior art, and provides a vehicle-mounted scheme for carrying out multi-mode interaction according to noise information.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
In order to solve the technical problems, the application is realized by adopting the following technical scheme:
a system for interaction according to noise information comprises a function triggering module, an information feedback module, a scene judging module, a voice module, an information output module and a graphic display module;
the function triggering module is used for triggering functions through the central control screen by a user;
the scene judging module is used for judging a user use scene;
the information feedback module is used for outputting dynamic effects and information of the man-machine interaction interface of the central control screen, outputting vibration positioning information and outputting and feeding back sound effect positioning information;
the information output module is used for outputting the information processed by the information feedback module to the central control screen for carrying out man-machine interaction interface dynamic effect and information output, seat vibration positioning output and sound positioning output;
the voice module comprises a sound source positioning processing unit, a sound filtering processing unit and a sound pressure processing unit and is used for identifying the sounding position, sound filtering and sound pressure processing;
the graphic display module is used for performing innovative graphic display on the central control screen according to the position of the sound source and the sound pressure value through the signal processing of the cabin domain controller.
Further, the scene judging module comprises a decompressed athletic scene unit and an environmental noise scene unit;
the decompression competitive scene unit is used for judging a single decompression competitive scene, only a driver at the main driving side detects the sounding action of a user, and judges the single decompression competitive scene;
the environment noise scene unit is used for judging the environment noise scene around the vehicle and the sound size of sound produced around the vehicle.
Further, the sound source positioning processing unit is used for identifying the position of sound production for sound source information collected by the microphone;
the sound filtering processing unit is used for filtering sound source sounds played by a user through the vehicle machine, and simultaneously accurately filtering sounds emitted by other users at other positions by combining sound source positioning;
the sound pressure processing unit is used for collecting and outputting sound pressure values through sound pressure, outputting sound position information and outputting accurate sound pressure values of corresponding positions to the cabin area controller for centralized processing.
Further, the information output module comprises a visual output unit, a tactile output unit and an auditory output unit;
the visual output unit is used for displaying dynamic effects and information of the human-machine interaction interface of the HMI;
the touch output unit is used for displaying vibration output information;
the hearing output unit is used for outputting and displaying the set sound corresponding to the sound field through the position of the user.
HMI is an abbreviation for Human Machine Interface, "human-machine interface," also known as human-machine interface. A human-machine interface (also known as a user interface or user interface) is the medium of interaction and exchange of information between a system and a user, which enables conversion between an internal form of information and a human-acceptable form.
Further, if the environment noise scene is, the voice module only collects sound pressure values, sound filtering processing is not carried out, the sound pressure values carry out HMI dynamic effect and information display through the central control screen, and meanwhile cabin vibration and sound are used for reminding a user that the current environment noise is too large, and the physical and mental health reminding of the user is influenced for a long time.
Further, the innovative graphic display is characterized in that the more broken squares represent larger sound pressure values, the louder the sound of the sound production of the user is, and the single person is a single-area display.
An interaction method of a system for interacting according to noise information, comprising the steps of:
1) The user clicks a sound control block applet through a central control screen to trigger the function;
2) The cabin camera monitoring system (DMS or OMS) intelligently identifies the number, the position and sounding action information of users in the vehicle and judges the scene;
3) The voice module processes the voice information, and accurately identifies the position of the sound source and the sound pressure value by combining the information of a cabin camera monitoring system (DMS or OMS);
4) And through the signal processing of the cabin domain controller, creative graphic display is carried out on the central control screen according to the sound source position and the sound pressure value.
Further, in the interaction method of the system for interaction according to the noise information, only a driver at the main driving side detects the sounding action of the user and judges that the single person decompresses the athletic scene;
the innovative graphic display appears as: the more broken squares represent the larger sound pressure value, the louder the user sounds, and the single person is a single area display.
An electronic device comprises a memory and a processor, wherein the memory is used for storing a computer program, the processor is used for calling and running the computer program stored in the memory, and the processor realizes the interaction method of the system for interaction according to noise information when executing the computer program.
A vehicle is provided with the system for interaction according to noise information.
Compared with the prior art, the application has the beneficial effects that:
the application is based on a central control screen, adopts multi-mode interaction, increases interesting construction, and caters to the intelligent and young development trend of the current automobiles;
according to the application, the automobile information is intuitively displayed in a graphical mode, so that the cognitive load of a user is reduced;
the application adds noise monitoring and sound health reminding functions in the cabin, combines multi-mode interaction and graphical visual display, so that a user can close sound health in the cabin in the form of an interesting game, and has fun and functionality, and the attention and using viscosity of the user are increased.
Drawings
The application is further described below with reference to the accompanying drawings:
FIG. 1 is a logic block diagram of an interaction method of a system for interacting according to noise information according to the present application;
FIG. 2 is an interface diagram of function trigger initiation of the present application;
FIG. 3a is a diagram of an interface for displaying functions of the present application in real time;
FIG. 3b is a second interface diagram showing the functions of the present application in real time.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application become more apparent, the technical solutions in the embodiments of the present application will be described in more detail below with reference to the accompanying drawings in the embodiments of the present application. In the drawings, the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The described embodiments are some, but not all, embodiments of the application. The embodiments described below by referring to the drawings are illustrative and intended to explain the present application and should not be construed as limiting the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application. Embodiments of the present application will be described in detail below with reference to the accompanying drawings.
In the description of the present application, it should be understood that the terms "center," "longitudinal," "lateral," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, merely to facilitate describing the present application and simplify the description, and do not indicate or imply that the devices or elements being referred to must have a specific orientation, be configured and operated in a specific orientation, and therefore should not be construed as limiting the scope of the present application.
The application is described in detail below with reference to the attached drawing figures:
a system for interaction according to noise information comprises a function triggering module, an information feedback module, a scene judging module, a voice module, an information output module and a graphic display module;
the function triggering module is used for triggering functions through the central control screen by a user;
the scene judging module is used for judging a user use scene;
the scene judging module comprises a decompressed athletic scene unit and an environmental noise scene unit;
the decompression competitive scene unit is used for judging a single decompression competitive scene, only a driver at the main driving side detects the sounding action of a user, and judges the single decompression competitive scene;
the environment noise scene unit is used for judging the environment noise scene around the vehicle and the sound size of sounding around the vehicle.
The information feedback module is used for the dynamic effect and information output of the man-machine interaction interface of the central control screen, the vibration positioning information output and the sound effect positioning information output feedback;
the information output module is used for outputting the information processed by the information feedback module to the central control screen for carrying out man-machine interaction interface dynamic effect and information output, seat vibration positioning output and sound positioning output;
the information output module comprises a visual output unit, a tactile output unit and an auditory output unit;
the visual output unit is used for displaying the dynamic effect and information of the human-machine interaction interface of the HMI;
the touch output unit is used for displaying vibration output information;
the hearing output unit is used for outputting and displaying the set sound corresponding to the sound field through the position of the user.
The voice module comprises a sound source positioning processing unit, a sound filtering processing unit and a sound pressure processing unit and is used for identifying the sounding position, sound filtering and sound pressure processing;
the sound source positioning processing unit is used for identifying the sounding position of sound source information collected by the microphone;
the sound filtering processing unit is used for filtering sound source sounds played by a user through the vehicle machine, and simultaneously combining sound source positioning to accurately filter sounds emitted by users at other positions;
the sound pressure processing unit is used for collecting and outputting sound pressure values through sound pressure, outputting sound position information and outputting accurate sound pressure values of corresponding positions to the cabin area controller for centralized processing.
The graphic display module is used for performing innovative graphic display on the central control screen according to the sound source position and the sound pressure value through the signal processing of the cabin domain controller.
The innovative graphic display is represented by the more broken squares representing a greater sound pressure value, the louder the user utters, and the single person is a single-area display.
An interaction method of a system for interacting according to noise information, comprising the steps of:
1) The user clicks a sound control block applet through a central control screen to trigger the function;
2) The cabin camera monitoring system (DMS or OMS) intelligently identifies the number, the position and sounding action information of users in the vehicle and judges the scene;
only the driver at the main driving side detects the sounding action of the user and judges that the single person decompresses the competitive scene;
3) The voice module processes the voice information, and accurately identifies the position of the sound source and the sound pressure value by combining the information of a cabin camera monitoring system (DMS or OMS);
4) And through the signal processing of the cabin domain controller, creative graphic display is carried out on the central control screen according to the sound source position and the sound pressure value.
Examples
1. Function triggering: and the user clicks the corresponding function icon through the central control screen to trigger the function.
2. Cabin equipment: the system comprises a function triggering module, an information feedback module, a scene judging module, a voice module, an information output module and a graphic display module, wherein related main equipment comprises a central control screen, a microphone, a cabin camera monitoring system, a voice system, a cabin domain controller, a seat, a sound box and the like.
3. And (3) information feedback: visual-central control screen man-machine interaction interface dynamic effect and information output, touch-seat vibration positioning output and auditory-sound effect positioning output.
4. Functional principle and scenario application:
the cabin camera monitoring system in the automobile cabin is used for identifying the number, the positions, the actions and the like of users in the automobile, and intelligently judging the use scene (decompression athletic scene/environmental noise scene) of the users.
(1) Multi-person decompression athletic scene: i.e. the user in the cabin will make a competition match by sound size.
After the sound information is received by the microphone, the microphone collects sound source information and transmits the information to the voice module, and the voice module can identify the sounding position according to the sound source positioning function; the voice module comprises a sound source positioning processing unit, a sound filtering processing unit and a sound pressure processing unit. The sound filtering processing unit is used for filtering sound source sounds actively played by users such as music played by the vehicle and the like, and simultaneously combining the sound source positioning processing unit to accurately filter sounds emitted by users at other positions; and finally, outputting a sound pressure value through a sound pressure processing unit, outputting sound position information and outputting an accurate sound pressure value at a corresponding position to a cabin controller for centralized processing. The processed information is output to a central control screen for human-computer interaction interface dynamic effect and information output (the number of displayed areas is corresponding to and the same as the number of personnel in the cabin), seat vibration positioning output and sound positioning output. The method is characterized in that a user with loud sound and a human-computer interaction interface have more broken boxes in a corresponding position area for information display in vision; haptic, corresponding to the vibration output of the seat where the user is; the sound audibly representing the winning will be output corresponding to the sound field by the location where the user is located.
(2) Single ambient noise scene: the voice module only collects sound pressure values, sound filtering processing is not carried out, the sound pressure values carry out human-computer interaction interface dynamic effects and information display (single-area display, the larger the sound is, the more the square blocks are broken, the health reminding mark will be exposed), the sound pressure values exceed a certain sound pressure value, cabin vibration is assisted, the current environment of a user is prompted, the noise is overlarge, the physical and mental health of the user will be influenced for a long time, and the like.
5. Operational steps and logic demonstration, see fig. 1:
1) The user triggers the function by clicking the applet on the central control screen, see fig. 2.
2) The microphone system collects information of each sound source in the cabin, and the information is transmitted to the cabin controller through sound source positioning processing, sound filtering processing and sound pressure processing of the voice system.
3) The cabin camera monitoring system intelligently recognizes information such as the number and the position of users in the vehicle, judges scenes (an environment noise scene or a multi-person decompression athletic scene) and transmits data to the cabin controller.
4) And the cabin camera system performs scene judgment. If the single environmental noise scene is identified, the cabin area controller only receives sound pressure processing data and sound source positioning processing, an instruction is sent to the central control screen and the seat, the central control screen performs single-area movement effect and information output, the larger the sound is, the more blocks are broken, health reminding marks are exposed (see fig. 3a and 3b, sound pressure values are divided into 5 levels to display corresponding blocks), when the health reminding marks are all exposed, cabin positioning vibration is assisted, a user is prompted, the current environmental noise is overlarge, the physical and mental health of the user is influenced for a long time, and the like; if the multi-person decompression athletic scene is identified, the cabin domain controller receives sound pressure processing data, sound source positioning processing and sound filtering processing data simultaneously, and sends instructions to a central control screen, a seat and sound equipment to perform central control screen dynamic effect and information output, seat vibration positioning output and sound equipment sound effect positioning output, wherein the method is characterized in that a user with loud sound has more broken boxes in a corresponding position area of visual, human-computer interaction interface dynamic effect and information display; haptic, corresponding to the vibration output of the seat where the user is; the sound audibly representing the winning will be output corresponding to the sound field by the location where the user is located.
An electronic device comprises a memory and a processor, wherein the memory is used for storing a computer program, the processor is used for calling and running the computer program stored in the memory, and the processor realizes the interaction method of the system for interaction according to noise information when executing the computer program.
A vehicle is provided with the system for interaction according to noise information.
The foregoing is merely illustrative of specific embodiments of the present application, and the scope of the application is not limited thereto, but any modifications, equivalents, improvements and alternatives falling within the spirit and principles of the present application will be apparent to those skilled in the art within the scope of the present application. And all that is not described in detail in this specification is well known to those skilled in the art.
Claims (10)
1. A system for interacting in accordance with noise information, characterized by: the system comprises a function triggering module, an information feedback module, a scene judging module, a voice module, an information output module and a graphic display module;
the function triggering module is used for triggering functions through the central control screen by a user;
the scene judging module is used for judging a user use scene;
the information feedback module is used for outputting dynamic effects and information of the man-machine interaction interface of the central control screen, outputting vibration positioning information and outputting and feeding back sound effect positioning information;
the information output module is used for outputting the information processed by the information feedback module to the central control screen for carrying out man-machine interaction interface dynamic effect and information output, seat vibration positioning output and sound positioning output;
the voice module comprises a sound source positioning processing unit, a sound filtering processing unit and a sound pressure processing unit and is used for identifying the sounding position, sound filtering and sound pressure processing;
the graphic display module is used for performing innovative graphic display on the central control screen according to the position of the sound source and the sound pressure value through the signal processing of the cabin domain controller.
2. A system for interaction based on noise information as defined in claim 1, wherein:
the scene judging module comprises a decompressed athletic scene unit and an environmental noise scene unit;
the decompression competitive scene unit is used for judging a single decompression competitive scene, only a driver at the main driving side detects the sounding action of a user, and judges the single decompression competitive scene;
the environment noise scene unit is used for judging the environment noise scene around the vehicle and the sound size of sound produced around the vehicle.
3. A system for interaction based on noise information as defined in claim 1, wherein:
the sound source positioning processing unit is used for identifying the sounding position of sound source information collected by the microphone;
the sound filtering processing unit is used for filtering sound source sounds played by a user through the vehicle machine, and simultaneously accurately filtering sounds emitted by other users at other positions by combining sound source positioning;
the sound pressure processing unit is used for collecting and outputting sound pressure values through sound pressure, outputting sound position information and outputting accurate sound pressure values of corresponding positions to the cabin area controller for centralized processing.
4. A system for interaction based on noise information as defined in claim 1, wherein:
the information output module comprises a visual output unit, a tactile output unit and an auditory output unit;
the visual output unit is used for displaying the dynamic effect and information of the man-machine interaction interface;
the touch output unit is used for displaying vibration output information;
the hearing output unit is used for outputting and displaying the set sound corresponding to the sound field through the position of the user.
5. A system for interaction based on noise information as defined in claim 3, wherein:
if the environment noise scene is, the voice module only collects sound pressure values, sound filtering processing is not carried out, the sound pressure values carry out HMI dynamic effect and information display through the central control screen, and meanwhile cabin vibration and sound are used for reminding a user that the current environment noise is too large, and the physical and mental health reminding of the user is influenced for a long time.
6. A system for interaction based on noise information as defined in claim 1, wherein:
the innovative graphic display is characterized in that the more broken squares represent the larger sound pressure value, the louder the sound of the user sounds, and the single person is a single-area display.
7. A method of interaction in a system for interaction based on noise information according to any of claims 1 to 6, comprising the steps of:
1) The user clicks a sound control block applet through a central control screen to trigger the function;
2) The cabin camera monitoring system intelligently identifies the number, the position and sounding action information of users in the vehicle and judges scenes;
3) The voice module processes the sound information, and accurately identifies the position of the sound source and the sound pressure value by combining the cabin camera monitoring system information;
4) And through the signal processing of the cabin domain controller, creative graphic display is carried out on the central control screen according to the sound source position and the sound pressure value.
8. The method of interaction of claim 7, wherein,
only the driver at the main driving side detects the sounding action of the user and judges that the single person decompresses the competitive scene;
the innovative graphic display appears as: the more broken squares represent the larger sound pressure value, the louder the user sounds, and the single person is a single area display.
9. An electronic device comprising a memory for storing a computer program and a processor for calling and running the computer program stored in the memory, characterized in that the processor implements the interaction method of the system according to noise information according to any of the preceding claims 6-8 when executing the computer program.
10. A vehicle on which the system according to any one of claims 1 to 5 is mounted, the system being configured to interact with noise information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310684225.2A CN116860196A (en) | 2023-06-12 | 2023-06-12 | System and method for interaction according to noise information, electronic equipment and vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310684225.2A CN116860196A (en) | 2023-06-12 | 2023-06-12 | System and method for interaction according to noise information, electronic equipment and vehicle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116860196A true CN116860196A (en) | 2023-10-10 |
Family
ID=88218083
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310684225.2A Pending CN116860196A (en) | 2023-06-12 | 2023-06-12 | System and method for interaction according to noise information, electronic equipment and vehicle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116860196A (en) |
-
2023
- 2023-06-12 CN CN202310684225.2A patent/CN116860196A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109416733A (en) | Portable personalization | |
| JP6328711B2 (en) | Navigation sound scaling | |
| CN102030008B (en) | Emotive advisory system | |
| CN1894740B (en) | Information processing system, information processing method, and information processing program | |
| CN106030697B (en) | On-vehicle control apparatus and vehicle-mounted control method | |
| CN110288987A (en) | Method for handling the system of voice data and controlling the system | |
| CN106448259B (en) | A kind of method, apparatus and system of vehicle early warning | |
| CN109941231B (en) | Vehicle-mounted terminal equipment, vehicle-mounted interaction system and interaction method | |
| JP6810764B2 (en) | Methods, devices, electronics and computer readable storage media used for human-machine interaction | |
| CN106954140A (en) | A kind of reminding method of barrier, device and barrier prompt system | |
| CN112185415A (en) | Sound visualization method and device, storage medium and MR mixed reality equipment | |
| CN116572260A (en) | Emotion communication accompanying and nursing robot system based on artificial intelligence generated content | |
| CN114103850A (en) | System for realizing active sound enhancement of automobile | |
| CN116860196A (en) | System and method for interaction according to noise information, electronic equipment and vehicle | |
| CN103167125B (en) | Mobile phone music playing system and method for the blind | |
| CN112009395A (en) | Interaction control method, vehicle-mounted terminal and vehicle | |
| CN110929078A (en) | Automobile voice image reloading method, device, equipment and storage medium | |
| CN115482583A (en) | Vehicle-mounted sign language translation method | |
| EP4129766A1 (en) | Sound data processing device and sound data processing method | |
| CN112455370A (en) | Emotion management and interaction system and method based on multidimensional data arbitration mechanism | |
| CN110139205B (en) | Method and device for auxiliary information presentation | |
| CN113539282A (en) | Sound processing device, system and method | |
| CN112673423A (en) | In-vehicle voice interaction method and equipment | |
| CN110843790A (en) | Method, device and equipment for cooperative control of hardware in vehicle | |
| CN111783550B (en) | Monitoring and adjusting method and system for emotion of driver |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |