CN116828384A - Sound field control method and device, electronic equipment and storage medium - Google Patents

Sound field control method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN116828384A
CN116828384A CN202310961608.XA CN202310961608A CN116828384A CN 116828384 A CN116828384 A CN 116828384A CN 202310961608 A CN202310961608 A CN 202310961608A CN 116828384 A CN116828384 A CN 116828384A
Authority
CN
China
Prior art keywords
vehicle
target object
virtual reality
riding
seat
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310961608.XA
Other languages
Chinese (zh)
Inventor
郭颖山
包楠
唐如意
谭毅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing Selis Phoenix Intelligent Innovation Technology Co ltd
Original Assignee
Chongqing Seres New Energy Automobile Design Institute Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing Seres New Energy Automobile Design Institute Co Ltd filed Critical Chongqing Seres New Energy Automobile Design Institute Co Ltd
Priority to CN202310961608.XA priority Critical patent/CN116828384A/en
Publication of CN116828384A publication Critical patent/CN116828384A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/302Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303Tracking of listener position or orientation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/308Electronic adaptation dependent on speaker or headphone connection

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Abstract

The application relates to the technical field of automobile control, and provides a sound field control method, a sound field control device, electronic equipment and a storage medium. The method comprises the steps of determining the working state of virtual reality equipment connected with a vehicle; if the working state of the virtual reality equipment is a target state, determining the position of a target object in the vehicle, wherein the target object is an object wearing the virtual reality equipment; according to the position of the target object in the vehicle, the sound field in the vehicle is adjusted according to the position of the target object in the vehicle, when the virtual reality equipment is used by the target object, the position of the target object in the vehicle is automatically acquired, and the sound field in the vehicle is automatically adjusted according to the position of the target object in the vehicle, so that the target object also has good sound effect experience when the virtual reality equipment is used, and the problem that the impression experience effect of the target object in the vehicle is poor due to the fact that the vehicle cannot be operated to manually adjust the sound field in the vehicle when the virtual reality equipment is used by the target object is avoided.

Description

Sound field control method and device, electronic equipment and storage medium
Technical Field
The present application relates to the field of automobile control technologies, and in particular, to a sound field control method, a sound field control device, an electronic device, and a storage medium.
Background
With the rapid development of intelligent vehicles and vehicle-mounted terminal technologies, people do not simply use the vehicle as a vehicle when driving, and gradually enjoy the life in the vehicle. Car audio enables drivers and passengers to enjoy music while riding, relieves fatigue, and is increasingly used in vehicles.
At present, for sound field adjustment of an intelligent cabin, only a sound setting interface of a user at a vehicle machine end is basically supported to manually drag a sound field focus, so that the sound field position is switched among main driving, auxiliary driving, left rear, right rear and rear row central positions. The existing sound field adjusting mode has the following defects: when the user uses the virtual reality device, the vehicle machine cannot be operated, and the user cannot adjust the sound field at the sound setting interface, so that the user cannot obtain good sound effect experience.
Disclosure of Invention
In view of the above, embodiments of the present application provide a sound field control method, apparatus, electronic device, and storage medium, so as to solve the problem in the prior art that when a target object cannot operate a vehicle to manually adjust a sound field in a vehicle, the sound effect experience effect of the target object is poor.
In a first aspect of an embodiment of the present application, there is provided a sound field control method including: determining the working state of virtual reality equipment connected with a vehicle; if the working state of the virtual reality equipment is a target state, determining the position of a target object in the vehicle, wherein the target object is an object wearing the virtual reality equipment, and the target state is used for representing the state that the virtual reality equipment outputs audio through a loudspeaker of the vehicle; the sound field inside the vehicle is adjusted according to the position of the target object inside the vehicle.
In a second aspect of the embodiments of the present application, there is provided a sound field control apparatus including: the state determining module is used for determining the working state of virtual reality equipment connected with the vehicle; the position determining module is used for determining the position of a target object in the vehicle if the working state of the virtual reality equipment is a target state, wherein the target object is an object wearing the virtual reality equipment, and the target state is used for representing the state that the virtual reality equipment outputs audio through a loudspeaker of the vehicle; and the sound field adjusting module is used for adjusting the sound field in the vehicle according to the position of the target object in the vehicle.
In a third aspect of the embodiments of the present application, there is provided an electronic device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the steps of the above method when executing the computer program.
In a fourth aspect of the embodiments of the present application, there is provided a computer readable storage medium storing a computer program which, when executed by a processor, implements the steps of the above method.
Compared with the prior art, the embodiment of the application has the beneficial effects that: in the embodiment of the application, the working state of the virtual reality equipment connected with the vehicle is determined; if the working state of the virtual reality equipment is a target state, determining the position of a target object in the vehicle, wherein the target object is an object wearing the virtual reality equipment; according to the position of the target object in the vehicle, the sound field in the vehicle is adjusted according to the position of the target object in the vehicle, when the virtual reality equipment is used by the target object, the position of the target object in the vehicle is automatically acquired, and the sound field in the vehicle is automatically adjusted according to the position of the target object in the vehicle, so that the target object also has good sound effect experience when the virtual reality equipment is used, and the problem that the impression experience effect of the target object in the vehicle is poor due to the fact that the vehicle cannot be operated to manually adjust the sound field in the vehicle when the virtual reality equipment is used by the target object is avoided.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic flow chart of a sound field control method provided in an application embodiment;
fig. 2 is a schematic flow chart of a sound field control method according to an embodiment of the present application;
fig. 3 is a schematic flow chart of another sound field control method according to an embodiment of the present application;
fig. 4 is a flow chart of still another sound field control method according to an embodiment of the present application;
FIG. 5 is a flow chart of yet another sound field control method according to an embodiment of the present application;
FIG. 6 is a flow chart of yet another alternative sound field control method provided by an embodiment of the present application;
FIG. 7 is a schematic diagram of a target object according to an embodiment of the present application being a primary seat position;
FIG. 8 is a schematic diagram of a target object according to an embodiment of the present application being a secondary seat position;
FIG. 9 is a schematic diagram of a target object according to an embodiment of the present application in a left rear seat position;
FIG. 10 is a schematic diagram of a target object position right rear seat position according to an embodiment of the present application;
FIG. 11 is a flow chart of another alternative sound field control method provided by an embodiment of the present application;
fig. 12 is a schematic structural diagram of a sound field control apparatus according to an embodiment of the present application;
fig. 13 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth such as the particular system architecture, techniques, etc., in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
A sound field control method and apparatus according to embodiments of the present application will be described in detail with reference to the accompanying drawings.
Fig. 1 is a schematic flow chart of a sound field control method according to an embodiment of the present application, as shown in fig. 1, where the sound field control method includes:
S101, determining the working state of virtual reality equipment connected with a vehicle;
s102, if the working state of the virtual reality equipment is a target state, determining the position of a target object in the vehicle, wherein the target object is an object wearing the virtual reality equipment, and the target state is used for representing the state that the virtual reality equipment outputs audio through a loudspeaker of the vehicle;
s103, adjusting the sound field of the vehicle interior according to the position of the target object in the vehicle interior.
Specifically, the sound field control method provided in this embodiment is applied to vehicles, where the vehicles may be all devices with mobility, including vehicles with autopilot or intelligent driving (including passenger vehicles (e.g., cars, buses, wagons, etc.), cargo vehicles (e.g., general trucks, vans, dump trucks, closed trucks, tank trucks, flat trucks, container cars, dump trucks, special structure trucks), special vehicles (e.g., logistics distribution vehicles, automated guided vehicles AGVs, patrol cars, cranes, excavators, bulldozers, forklift trucks, loaders, off-road engineering vehicles, armored vehicles, sewage treatment vehicles, sanitation vehicles, dust trucks, floor washing vehicles, sprinkler, sweeping robots, meal delivery robots, shopping guide robots, mowers, golf carts, etc.), vehicles with entertainment functions (e.g., recreational vehicles, amusement park autopilots, balance cars, etc.), rescue vehicles (e.g., fire fighters, rescue vehicles, electric power emergency vehicles, engineering vehicles, etc.), and the like).
It will be appreciated that the virtual reality device can establish a connection with the vehicle via a wired connection, including but not limited to a coaxial cable, twisted pair wire, and fiber optic connected wired network, and/or via a wireless connection, such as a wireless network that enables interconnection of various communication devices without wiring, such as Bluetooth (Bluetooth), near field communication (Near Field Communication, NFC), infrared (Infrared), wiFi, and the like.
Wherein, in the work state of the virtual reality equipment that confirm the vehicle and connect, the work state of the virtual reality equipment includes: any one of a self-play audio information play state, a play audio information play state through a vehicle speaker, and an audio information non-play state, including but not limited to: at least one of audio play information of music, audio play information of video, and game audio information. It can be appreciated that when the virtual reality device is in the working process, the virtual reality device is necessarily in at least one of an audio information playing state and an audio information non-playing state, and when the virtual reality device is in the audio information playing state, the sound of the vehicle outputs corresponding audio.
The above example is accepted, where the target state is a state of playing audio information through a vehicle speaker, that is, if the virtual reality device is in a state of playing audio information through a vehicle speaker, the working state of the virtual reality device is determined to be the target state, at this time, the vehicle automatically determines a position of a target object in the vehicle, where the target object is an object wearing the virtual reality device, and a specific manner of determining the target object will be described in detail later, and will not be described in detail here; likewise, the manner in which the vehicle automatically determines the position of the target object within the vehicle will be described in detail later, and will not be described in detail herein.
It can be understood that when the working state of the virtual reality device is the target state, the virtual reality device outputs audio through the speaker of the vehicle, so as to bring better sound effect experience to the target object, therefore, the sound field in the vehicle needs to be adjusted further according to the position of the target object in the vehicle, and better sound effect experience to the target object is further achieved.
Specifically, after determining the position of the target object in the vehicle, the vehicle automatically adjusts the sound field in the interior according to the position of the target object in the interior; for example, if the target object is at a secondary driver seat in the vehicle, the sound field in the interior is automatically adjusted to the secondary driver; for another example, the target object is at the left rear seat in the vehicle interior, so that the internal sound field is automatically adjusted to the left rear seat, and further, the internal sound field is automatically adjusted according to the internal position of the target object, so that the target object can obtain good sound effect experience.
According to the technical scheme provided by the embodiment of the application, the working state of the virtual reality equipment connected with the vehicle is determined; if the working state of the virtual reality equipment is a target state, determining the position of a target object in the vehicle, wherein the target object is an object wearing the virtual reality equipment; according to the position of the target object in the vehicle, the sound field in the vehicle is adjusted according to the position of the target object in the vehicle, when the virtual reality equipment is used by the target object, the position of the target object in the vehicle is automatically acquired, and the sound field in the vehicle is automatically adjusted according to the position of the target object in the vehicle, so that the target object also has good sound effect experience when the virtual reality equipment is used, and the problem that the impression experience effect of the target object in the vehicle is poor due to the fact that the vehicle cannot be operated to manually adjust the sound field in the vehicle when the virtual reality equipment is used by the target object is avoided.
In some embodiments, as shown in fig. 2, determining an operational state of a virtual reality device connected to a vehicle includes:
s201, determining whether the virtual reality device establishes communication connection with the vehicle;
s202, if the virtual reality device is in communication connection with the vehicle and the virtual reality device is in the vehicle, determining the working state of the virtual reality device connected with the vehicle.
Specifically, when the virtual reality device is started up and the virtual reality device is connected with the vehicle in a wired connection and/or wireless connection mode, the vehicle determines whether the virtual reality device is in the vehicle at the moment; if the virtual reality device is not connected with the vehicle in a wired or wireless connection manner, the vehicle will not determine whether the virtual reality device is in the vehicle at this time, and will not execute the subsequent step of determining the working state of the virtual reality device connected with the vehicle.
The vehicle can determine whether the virtual reality device is in the vehicle through various modes, for example, the vehicle determines whether the virtual reality device is in the vehicle through the strength of a connection signal of the virtual reality device, if the strength of the connection signal exceeds a signal threshold value, the virtual reality device is in the vehicle, otherwise, if the strength of the connection signal does not exceed the signal threshold value, the virtual reality device is not in the vehicle; for another example, the vehicle determines whether the virtual reality device is present inside the vehicle through an internal camera.
In the above example, when the vehicle determines that the communication connection is established with the virtual reality device and the virtual reality device is located inside the vehicle, the vehicle determines the working state of the virtual reality device connected with the vehicle. For example, when the virtual reality device is started in the vehicle, the virtual reality device is automatically matched and connected with the vehicle machine of the vehicle in a Wifi or bluetooth connection mode, and at the moment, the vehicle machine of the vehicle judges that the current virtual reality device is in the use process, the working state of the virtual reality device connected with the vehicle can be further judged, and the subsequent steps are determined according to the working state of the virtual reality device; it can be understood that if the vehicle determines that the working state of the virtual reality device is not the target state, the vehicle will not execute the subsequent steps of determining the position of the target object in the vehicle, and at this time, the vehicle will be provided with a current sound field, and will not be changed.
According to the technical scheme provided by the embodiment of the application, whether the virtual reality equipment is in communication connection with the vehicle or not is determined; if the virtual reality device is in communication with the vehicle, and the virtual reality device is in the vehicle, the working state of the virtual reality device connected with the vehicle is determined, by the method, the working state of the virtual reality device connected with the vehicle is determined only when the virtual reality device is used in the vehicle, and the sound field in the vehicle is adjusted according to the working state, so that when the virtual reality device is outside the vehicle, the virtual reality device is connected with the vehicle, the working state of the virtual reality device is in a target state, the follow-up step is still performed to adjust the sound field in the vehicle, the resulting problem of wasting resources is solved, and the effect of saving system resources is achieved by adjusting the sound field in the vehicle according to the follow-up step only when the virtual reality device is in the vehicle.
In some embodiments, as shown in fig. 3, determining the location of the target object inside the vehicle includes:
s301, determining the seat position of a riding object in the vehicle through a pressure sensor arranged on the seat in the vehicle;
S302, determining a target object from the riding objects, and taking the determined seat position of the riding object as the position of the target object in the vehicle.
Specifically, the vehicle can determine the riding conditions of the main driving seat, the auxiliary driving seat, the left rear seat, the right rear seat and other positions in the vehicle, and the specific modes are as follows: by arranging pressure sensors (taking the pressure sensors as a group of film type contact sensors as an example below) in the seat cushion of each seat respectively, wherein the 12 film type contact sensors are a group of film type contact sensors, the contacts of each film type contact sensor are uniformly distributed on the stress surface of the seat, when a sitting object enters the cabin of a vehicle to sit, the seat receives pressure from the outside, at the moment, the seat cushion deforms, so that the film stress of the film type contact sensor also deforms, the resistance of carbon paste in the film type contact sensor changes, and the vehicle confirms that the seat sits with the sitting object if measuring a pressure signal generated by the change condition of the resistance of the film type contact sensor; if the seat is not occupied, the seat cushion will not deform, the thin film type contact sensor thin film remains unchanged, the resistance is stable and unchanged, and the vehicle confirms that the seat is unoccupied.
It can be appreciated that the present embodiment does not limit the number of seats within the vehicle, for example, in some examples, the vehicle is a two-seat vehicle, and only primary and secondary seats are present within the vehicle; for another example, if the vehicle is a five-seat vehicle, there are a main seat, a sub-seat, a left rear seat, a right rear seat, a rear middle seat, and the like in the vehicle.
After determining the seat position of the riding object in the vehicle, the vehicle determines a target object from the riding objects, and takes the determined seat position of the riding object as the position of the target object in the vehicle. For example, the vehicle determines that seat positions of a riding object in the vehicle interior are a left rear seat and a right rear seat, respectively, by pressure sensors provided on the seats in the vehicle; and from the determination that the seating object seating the left rear seat is the target object, the left rear seat is regarded as the position in the vehicle interior of the target object.
According to the technical scheme provided by the embodiment of the application, the seat position of a riding object in a vehicle is determined through the pressure sensor arranged on the seat in the vehicle; the target object is determined from the riding objects, the determined seat position of the riding object is used as the position of the target object in the vehicle, the effect of accurately acquiring the seat position of the riding object in the vehicle through the pressure sensor is achieved, and then when the target object in the riding object is determined, the position of the riding object is directly used as the position of the target object, and further the effect of accurately acquiring the position of the target object is achieved, and user experience is improved.
In some embodiments, as shown in fig. 4, determining a target object from among the riding objects, and taking the determined seat position of the riding object as the position of the target object in the vehicle interior includes:
s401, if there is only one riding object in the vehicle and the seat of the riding object is a non-main driving seat, directly taking the riding object as a target object and taking the seat position of the riding object as the position of the target object in the vehicle;
s402, if only one riding object exists in the vehicle and the seat of the riding object is a main driving seat, determining the state of the vehicle; if the state of the vehicle is a preset state, the riding object is taken as a target object, and the seat position of the riding object is taken as the position of the target object in the vehicle.
Specifically, the above step S401 and the above step S402 are in a parallel relationship, which does not have a sequential relationship, that is, the vehicle determines the target object through the above step S401 or the above step S402, and determines the position of the target object inside the vehicle.
In step S401, if only one occupant is present in the vehicle and the seat of the occupant is a non-main seat, the occupant is directly targeted and the seat position of the occupant is targeted at the position of the occupant in the vehicle; for example, only one riding object exists in the vehicle, the seat on which the riding object sits is a secondary driving seat and is not a primary driving seat, at this time, since only one riding object exists in the vehicle, the riding object is directly defaulted to be a target object with virtual reality equipment, and the secondary driving seat is taken as the position of the target object in the vehicle, thereby avoiding the determination of the target object through other sensors and saving system resources.
In step S402, the preset state is an un-driven state, and in order to avoid an accident during driving of the vehicle, when the vehicle is in a driving state, the riding object of the default main driving seat cannot use the virtual reality device, so if there is only one riding object in the vehicle, and the seat of the riding object is the main driving seat, the state of the vehicle needs to be further determined; if the state of the vehicle is a preset state, taking the riding object as a target object, and taking the seat position of the riding object as the position of the target object in the vehicle; otherwise, if the state of the vehicle is not the preset state, the situation that the target object is not in the vehicle is judged at the moment, and the subsequent step of adjusting the sound field in the vehicle is stopped.
For example, when the vehicle has a main driving seat, the current state of the vehicle is further acquired, and when the current state of the vehicle is a non-driving state, the main driving seat is confirmed to be a target object wearing virtual reality equipment, and the main driving seat is taken as the position of the target object in the vehicle, so that the determination of the target object by other sensors is avoided, and system resources are saved; otherwise, if the current state of the vehicle is a running state, judging that no target object exists in the vehicle, and stopping the subsequent step of adjusting the sound field in the vehicle, so that invalid operation caused by the fact that the vehicle still executes the subsequent step of adjusting the sound field in the vehicle is avoided, and system resources are saved.
It can be appreciated that in some examples, if there is only one occupant in the vehicle, the occupant is directly targeted and the seat position of the occupant is targeted to the position of the occupant in the vehicle without further determination of whether the occupant's seat is a primary seat and the current state of the vehicle.
According to the technical scheme provided by the embodiment of the application, the target object is determined from the riding objects through the step S401 and the step S402, and the determined seat position of the riding object is used as the position of the target object in the vehicle, so that when only one riding object exists in the vehicle, the target object can be determined directly according to the pressure sensor, further, the determination of the target object through other sensors is avoided, and the system resource is saved.
In some embodiments, as shown in fig. 5, determining a target object from among the riding objects, and taking the determined seat position of the riding object as the position of the target object in the vehicle interior includes:
s501, if at least two riding objects exist in the vehicle, performing image shooting on areas of the at least two riding objects in the vehicle through shooting equipment arranged in the vehicle to obtain area images;
S502, determining a target object from at least two riding objects according to the area image, and taking the seat position of the determined riding object as the position of the target object in the vehicle.
Specifically, the embodiment does not limit the specific product or type of the photographing device in step S501, and the specific product or type of the photographing device may be flexibly set by the related personnel; the photographing device only photographs the region where the riding object is located, other regions cannot be photographed, and privacy leakage of a user using the vehicle is further avoided on the basis of saving system resources. For example, if two passengers are present in the vehicle, and the seats on which the two passengers are respectively seated are a left rear seat and a right rear seat, the vehicle photographs the left and right seat positions and the right rear seat position by an internally provided photographing device, and further obtains an area image of the left rear seat position and an area image of the right rear seat position.
In the above example, after the area image is acquired, a target object is determined from at least two riding objects according to the area image, and the determined seating position of the riding object is taken as the position of the target object in the vehicle, specifically, the area image containing the virtual reality device is determined by performing virtual reality device identification in the area image, then the riding object in the area image containing the virtual reality device is taken as the target object, and the determined seating position of the riding object is taken as the position of the target object in the vehicle. For example, the vehicle photographs the left and right seat positions and the right rear seat position through a photographing device arranged in the vehicle, so as to obtain an area image of the left rear seat position and an area image of the right rear seat position, respectively performing virtual reality equipment identification on the left rear area image and the right rear area image, further determining an area image containing virtual reality equipment, and if the left rear area image contains the virtual reality equipment, directly taking a riding object at the left rear seat as a target object and taking the left rear seat as the position of the target object in the vehicle; conversely, if the right rear area image includes a virtual reality device, the seating object at the right rear seat is directly set as the target object, and the right rear seat is set as the position of the target object in the vehicle interior.
In some examples of the present embodiment, it is also possible to panoramic photograph the vehicle interior to obtain a panoramic image, then determine a target object from at least two riding objects according to the panoramic image, and take the determined seating position of the riding object as the position of the target object in the vehicle interior. Specifically, for example, taking four positions of a main driving seat, a sub driving seat, a left rear seat and a right rear seat in a vehicle as an example, the vehicle invokes an in-vehicle passenger monitoring system (Occupancy Monitoring System, OMS) camera in the vehicle to identify the position of the virtual reality device in the main driving seat/the sub driving seat/the left rear seat/the right rear seat at the moment according to visual identification comparison; the specific method is as follows: the OMS firstly shoots a photo covering all positions in the vehicle, the photo is partitioned according to four positions of a main driving seat, a secondary driving seat, a left rear seat and a right rear seat, an image of a region corresponding to the position of the seat where a riding object sits is stored in advance is compared with an image stored in a database, a target image which is the most approximate to the current image in the database is obtained, each image in the database is marked with a corresponding virtual reality device signal, the height of a wearer and the gesture of the head, the same virtual reality device can correspond to users with different heights, a plurality of wearing gestures and virtual reality device pictures with different models are reserved in the database, and the database can be dynamically updated through a cloud.
If the region image (i.e. main driving/auxiliary driving/left rear/right rear) of a certain riding object in the current picture is most similar to the image of the passenger wearing VR in the database, the vehicle-mounted intelligent VR device is judged to be worn and used by the passenger riding at the position, and then the vehicle takes the position as the position of the target object.
It can be appreciated that in some examples, the location of the target object within the vehicle includes: a seat position of the target object in the vehicle and a height of the target object at the seat position; after the vehicle determines the seat position where the target object is located, the height of the target object at the seat position may be further determined by the photographing device, where a specific height determining manner may be flexibly set by a relevant person, and this embodiment is not limited thereto.
According to the technical scheme provided by the embodiment of the application, if at least two riding objects exist in the vehicle, the image of the areas of the at least two riding objects in the vehicle is shot through shooting equipment arranged in the vehicle, so that an area image is obtained; the method comprises the steps of determining target objects from at least two riding objects according to area images, taking the determined seat positions of the riding objects as the positions of the target objects in a vehicle, wherein after the riding seats of the riding objects are determined through pressure sensors, carrying out area shooting on the seat positions of the riding objects through shooting devices, further realizing accurate determination of the target objects in the riding objects, avoiding panoramic shooting in the vehicle on the basis of achieving accurate determination of the target objects, saving system resources, and further avoiding privacy leakage in the vehicle caused by panoramic shooting.
In some examples, as shown in fig. 6, adjusting the sound field of the vehicle interior according to the position of the target object in the vehicle interior includes:
s601, obtaining the distance between each loudspeaker in the vehicle and the target object to determine the farthest loudspeaker in the loudspeakers, wherein the farthest loudspeaker is the loudspeaker with the longest distance from the target object;
s602, respectively carrying out delay setting on other speakers according to the distance between the farthest speaker and the target object so as to adjust the sound field in the vehicle.
Specifically, a plurality of speakers are included in the vehicle, wherein in order to keep the time of arrival of audio output by each speaker at the target object always synchronous, the sound effect of the target object when using the virtual reality device is improved, and therefore, it is necessary to perform delay setting for the speakers, respectively. For example, when there are three speakers A, B and C in the vehicle and the distances between the three speakers A, B and C and the target object are different, it is necessary to determine the distances between the three speakers A, B and C and the target object, and the distances between the three speakers A, B and C and the target object are X, Y and Z, respectively, and X > Y, and X is greater than Z, then the speaker a is taken as the farthest speaker, and then the speakers B and C are set with a delay according to the distances between the speaker a and the target object, respectively, so as to adjust the sound field in the vehicle.
According to the distance between the farthest loudspeaker and the target object, the other loudspeakers are respectively delayed to adjust the sound field in the vehicle, and the method specifically comprises the following steps: the method comprises the steps of respectively obtaining the linear distances between a farthest loudspeaker and other loudspeakers and a target object, then determining the sound propagation speed, respectively bringing the linear distances between the farthest loudspeaker and the target object, the linear distances between the other loudspeakers and the target object and the sound propagation speed into a target formula, further determining the delay time of the other loudspeakers, and then carrying out delay setting on the other loudspeakers according to the delay time to further adjust the sound field in the vehicle, wherein the target formula is as follows:
where Tn is the delay time (in milliseconds ms) of other speakers, X max For the straight line distance of the farthest loudspeaker and the target object, X n For the linear distance between the Nth other speaker and the target object (N is the number of speakers in the vehicle minus 1), z is the sound propagation speed, where X max And X is n The units of (2) are: millimeter (mm), Z is measured in meters (m).
In order to better understand the foregoing, this example provides a more specific example for illustration:
Example 1, as shown in fig. 7, taking the position of the target object as the main driving seat position, and taking the distance from the speaker to the main driving seat as the distance from the speaker to the main driving seat center, firstly, the distance from each speaker to the main driving seat center is obtained (for example, the distance from each speaker to the main driving seat center is measured by a ruler; for example, the distance from the speaker to the main driving seat center is determined by an infrared distance measuring device), and is respectively denoted as X1, X2, X3 … … XN, then the maximum value Xmax is determined from X1, X2 and X3 … … XN, the distance from the other speakers to the main driving seat center is sequentially subtracted by using the distance maximum value Xmax, then the subtracted value is divided by 340 (namely, the single propagation speed of sound under the normal atmospheric pressure), and multiplied by 1000, and the time delay Tn (unit: ms) of each speaker to the main driving seat headrest can be obtained by the specific formula:
example 2, as shown in FIG. 8, the position of the target object is taken asThe distance from the speaker to the secondary driving seat is exemplified by the distance from the speaker to the secondary driving seat in the middle of the headrest, firstly, the distance from each speaker to the middle of the headrest of the secondary driving seat is obtained (for example, the distance from each speaker to the middle of the headrest of the secondary driving seat is measured by a ruler; for example, the distance from the speaker to the middle of the headrest of the secondary driving seat is determined by an infrared distance measuring device) and is respectively marked as X1, X2 and X3 … … XN, then the maximum value Xmax is determined from the X1, X2 and X3 … … XN, the distance from other speakers to the middle of the headrest of the secondary driving seat is subtracted by the maximum value Xmax, and then the subtracted value is divided by 340 (namely, the single propagation speed of sound under the normal atmospheric pressure) and multiplied by 1000, so that the delay time value Tn (unit: ms) of the headrest of the secondary driving seat can be obtained by each speaker is obtained by the specific formula:
Example 3, as shown in fig. 9, taking the position of the target object as the position of the rear left seat, and taking the distance from the speaker to the rear left seat as an example, firstly, the distance from each speaker to the middle of the rear left seat headrest is obtained (for example, the distance from each speaker to the middle of the rear left seat headrest is measured by a ruler; for example, the distance from the speaker to the middle of the rear left seat headrest is determined by an infrared distance measuring device), and is respectively denoted as X1, X2, X3 … … XN, then the maximum value Xmax is determined from X1, X2, X3 … … XN, the distance from the other speakers to the middle of the rear left seat headrest is sequentially subtracted by using the distance maximum value Xmax, then the subtracted value is divided by 340 (namely, the single propagation speed of sound under the normal atmospheric pressure), and multiplied by 1000, the time delay value Tn (unit: ms) of each speaker to the rear left seat headrest can be obtained by the specific formula:
example 4 as shown in fig. 10, taking the position of the target object as the right rear seat position, and the distance from the speaker to the right rear seat as the distance from the speaker to the right rear and the middle of the headrest as an example,firstly, the distance between each loudspeaker and the right rear seat headrest is obtained (for example, the distance between each loudspeaker and the right rear seat headrest is measured by a ruler; for example, the distance between each loudspeaker and the right rear seat headrest is determined by an infrared distance measuring device and is respectively marked as X1, X2 and X3 … … XN, the maximum value Xmax is determined from X1, X2 and X3 … … XN, the distance between other loudspeakers and the right rear seat headrest is subtracted by using the maximum value Xmax, and then the subtracted value is divided by 340 (namely, the single propagation speed of sound under the normal atmospheric pressure) and multiplied by 1000, so that the delay time value Tn (unit: ms) of the right rear seat headrest where each loudspeaker is located can be obtained by the specific formula:
It can be appreciated that in some examples, the present example may also obtain a distance between each speaker and the target object in the vehicle, then take any speaker as the target speaker, and then determine a far-away speaker and a near-away speaker according to the distance between the target speaker and the target object, where the far-away speaker is a speaker whose distance from the target object exceeds the distance between the target speaker and the target object, the near-away speaker is a speaker whose distance from the target object is lower than the distance between the target speaker and the target object, then delay setting the near-away speaker, and set the far-away speaker in advance to adjust the sound field in the vehicle.
According to the technical scheme provided by the embodiment of the application, the furthest loudspeaker in the loudspeakers is determined by acquiring the distance between each loudspeaker in the vehicle and the target object, wherein the furthest loudspeaker is the loudspeaker with the longest distance from the target object; according to the distance between the farthest loudspeaker and the target object, the other loudspeakers are respectively delayed to adjust the sound field in the vehicle, and the distance between the farthest loudspeaker and the target object is used for delaying the other loudspeakers, so that the effect of accurately adjusting the sound field in the vehicle is achieved, the time from the audio output by each loudspeaker in the vehicle to the target object tends to be the same, and the sound effect experience of the target object when using the virtual reality device is improved.
In some examples, as shown in fig. 11, after adjusting the sound field of the vehicle interior according to the position of the target object in the vehicle interior, the method further includes:
s1101, periodically redefining the position of the target object in the vehicle;
s1102, if the position of the target object in the vehicle is updated, readjusting the sound field in the vehicle according to the updated position.
Specifically, periodically repositioning the target object within the vehicle includes the steps of: periodically re-determining the seat position of the riding object in the vehicle through a pressure sensor arranged on the seat in the vehicle; and re-determining the target object to achieve re-determination of the target object's position within the vehicle interior. For example, the seat pressure recognition period is 0.5s, and each 0.5s vehicle can redetermine the seating conditions of the main driving seat, the auxiliary driving seat, the left rear seat, the right rear seat and other positions in the vehicle, further redetermine the seating object in the vehicle, redetermine the target object based on the redetermined seating object by adopting the same method, and redetermine the position of the target object in the vehicle according to the redetermined target object.
After the above example is received and the position of the target object in the vehicle is redetermined according to the redetermined target object, the sound field in the vehicle is readjusted based on the same method, which is not described herein.
According to the technical scheme provided by the embodiment of the application, the position of the target object in the vehicle is periodically redetermined; if the position of the target object in the vehicle is updated, the sound field in the vehicle is readjusted according to the updated position, so that the effect of automatically updating and adjusting the sound field in the vehicle according to the position of the target object is achieved, and the audio experience of the target object when the virtual reality device is used in the vehicle is improved.
Any combination of the above optional solutions may be adopted to form an optional embodiment of the present application, which is not described herein.
The following are examples of the apparatus of the present application that may be used to perform the method embodiments of the present application. For details not disclosed in the embodiments of the apparatus of the present application, please refer to the embodiments of the method of the present application.
The present embodiment also provides a sound field control apparatus, as shown in fig. 12, which is applied to a vehicle, the apparatus including:
a state determination module 1201 configured to determine an operating state of a virtual reality device connected to the vehicle;
A position determining module 1202 configured to determine a position of a target object inside the vehicle if the operating state of the virtual reality device is a target state, the target object being an object wearing the virtual reality device, the target state being used to characterize a state in which the virtual reality device outputs audio through a speaker of the vehicle;
the sound field adjustment module 1203 is configured to adjust the sound field of the vehicle interior according to the position of the target object in the vehicle interior.
In some examples, the state determination module 1201 is further configured to determine whether the virtual reality device establishes a communication connection with the vehicle; and if the virtual reality device is in communication connection with the vehicle and the virtual reality device is in the vehicle, determining the working state of the virtual reality device connected with the vehicle.
In some examples, the position determination module 1202 is further configured to determine a seat position of the occupant inside the vehicle by a pressure sensor disposed on the seat in the vehicle; the target object is determined from among the riding objects, and the determined seating position of the riding object is taken as the position of the target object in the vehicle.
In some examples, the position determination module 1202 is further configured to target the occupant directly and target the seat position of the occupant as the position of the target in the vehicle interior if there is only one occupant in the vehicle and the occupant's seat is a non-primary seat; or if only one riding object exists in the vehicle and the seat of the riding object is a main driving seat, determining the state of the vehicle; if the state of the vehicle is a preset state, the riding object is taken as a target object, and the seat position of the riding object is taken as the position of the target object in the vehicle.
In some examples, the location determination module 1202 is further configured to, if there are at least two rides in the vehicle, image the area of the at least two rides in the vehicle by a photographing device provided in the vehicle to obtain an area image; and determining a target object from at least two riding objects according to the area image, and taking the seat position of the determined riding object as the position of the target object in the vehicle.
In some examples, the sound field adjustment module 1203 is further configured to obtain a distance from each speaker within the vehicle to the target object to determine a farthest speaker of the speakers, the farthest speaker being a speaker having a longest distance from the target object; and respectively carrying out delay setting on other speakers according to the distance between the farthest speaker and the target object so as to adjust the sound field in the vehicle.
In some examples, the location determination module 1202 is further configured to periodically re-determine the location of the target object inside the vehicle; the sound field adjustment module 1203 is further configured to readjust the sound field of the vehicle interior according to the updated position if the position of the target object in the vehicle interior is updated.
According to the technical scheme provided by the embodiment of the application, the device determines the working state of the virtual reality equipment connected with the vehicle; if the working state of the virtual reality equipment is a target state, determining the position of a target object in the vehicle, wherein the target object is an object wearing the virtual reality equipment; according to the position of the target object in the vehicle, the sound field in the vehicle is adjusted according to the position of the target object in the vehicle, when the virtual reality equipment is used by the target object, the position of the target object in the vehicle is automatically acquired, and the sound field in the vehicle is automatically adjusted according to the position of the target object in the vehicle, so that the target object also has good sound effect experience when the virtual reality equipment is used, and the problem that the impression experience effect of the target object in the vehicle is poor due to the fact that the vehicle cannot be operated to manually adjust the sound field in the vehicle when the virtual reality equipment is used by the target object is avoided.
Fig. 13 is a schematic diagram of an electronic device 13 according to an embodiment of the present application. As shown in fig. 13, the electronic device 13 of this embodiment includes: a processor 1301, a memory 1302 and a computer program 1303 stored in the memory 1302 and executable on the processor 1301. The steps of the various method embodiments described above are implemented when the processor 1301 executes the computer program 1303. Alternatively, the processor 1301 when executing the computer program 1303 implements the functions of the modules/units in the above-described apparatus embodiments.
The electronic device 13 may be a desktop computer, a notebook computer, a palm computer, a cloud server, or the like. The electronic device 13 may include, but is not limited to, a processor 1301 and a memory 1302. It will be appreciated by those skilled in the art that fig. 13 is merely an example of the electronic device 13 and is not limiting of the electronic device 13 and may include more or fewer components than shown, or different components.
Processor 1301 may be a central processing unit (Central Processing Unit, CPU) or other general purpose processor, digital signal processor (Digital Signal Processor, DSP), application specific integrated circuit (Application Specific Integrated Circuit, ASIC), field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like.
The memory 1302 may be an internal storage unit of the electronic device 13, for example, a hard disk or a memory of the electronic device 13. The memory 1302 may also be an external storage device of the electronic device 13, for example, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) or the like, which are provided on the electronic device 13. Memory 1302 may also include both internal and external storage units of electronic device 13. The memory 1302 is used to store computer programs and other programs and data required by the electronic device.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit.
The integrated modules/units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the present application may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, and the computer program may be stored in a computer readable storage medium, where the computer program, when executed by a processor, may implement the steps of each of the method embodiments described above. The computer program may comprise computer program code, which may be in source code form, object code form, executable file or in some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth. It should be noted that the content of the computer readable medium can be appropriately increased or decreased according to the requirements of the jurisdiction's jurisdiction and the patent practice, for example, in some jurisdictions, the computer readable medium does not include electrical carrier signals and telecommunication signals according to the jurisdiction and the patent practice.
The above embodiments are only for illustrating the technical solution of the present application, and are not limiting; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application, and are intended to be included in the scope of the present application.

Claims (10)

1. A sound field control method, the sound field control method being applied to a vehicle, the method comprising:
determining the working state of virtual reality equipment connected with the vehicle;
if the working state of the virtual reality equipment is a target state, determining the position of a target object in the vehicle, wherein the target object is an object wearing the virtual reality equipment, and the target state is used for representing the state that the virtual reality equipment outputs audio through a loudspeaker of the vehicle;
and adjusting the sound field in the vehicle according to the position of the target object in the vehicle.
2. The method of claim 1, wherein determining an operational state of a virtual reality device connected to the vehicle comprises:
determining whether the virtual reality device establishes a communication connection with the vehicle;
and if the virtual reality equipment is in communication connection with the vehicle and the virtual reality equipment is in the vehicle, determining the working state of the virtual reality equipment connected with the vehicle.
3. The method of claim 1, wherein determining the location of a target object within the vehicle interior comprises:
determining a seat position of a riding object in the vehicle by a pressure sensor arranged on a seat in the vehicle;
and determining the target object from the riding objects, and taking the determined seat position of the riding object as the position of the target object in the vehicle.
4. A method according to claim 3, wherein determining the target object from the riding objects and taking the determined seat position of the riding object as the position of the target object inside the vehicle comprises:
if only one riding object exists in the vehicle and the seat of the riding object is a non-main driving seat, the riding object is directly taken as the target object, and the seat position of the riding object is taken as the position of the target object in the vehicle;
Or alternatively, the first and second heat exchangers may be,
if only one riding object exists in the vehicle and the seat of the riding object is a main driving seat, determining the state of the vehicle;
and if the state of the vehicle is a preset state, taking the riding object as the target object, and taking the seat position of the riding object as the position of the target object in the vehicle.
5. A method according to claim 3, wherein determining the target object from the riding objects and taking the determined seat position of the riding object as the position of the target object inside the vehicle comprises:
if at least two riding objects exist in the vehicle, performing image shooting on the areas of the at least two riding objects in the vehicle through shooting equipment arranged in the vehicle to obtain area images;
and determining the target object from at least two riding objects according to the area image, and taking the determined seat position of the riding object as the position of the target object in the vehicle.
6. The method of claim 1, wherein adjusting the sound field of the vehicle interior based on the position of the target object within the vehicle interior comprises:
Obtaining the distance between each loudspeaker in the vehicle and the target object to determine the farthest loudspeaker in the loudspeakers, wherein the farthest loudspeaker is the loudspeaker with the longest distance from the target object;
and respectively carrying out delay setting on other speakers according to the distance between the farthest speaker and the target object so as to adjust the sound field in the vehicle.
7. The method of claim 1, wherein after adjusting the sound field of the vehicle interior based on the position of the target object in the vehicle interior, the method further comprises:
periodically redefining the position of the target object in the vehicle interior;
and if the position of the target object in the vehicle is updated, readjusting the sound field in the vehicle according to the updated position.
8. A sound field control apparatus, the apparatus being applied to a vehicle, the apparatus comprising:
the state determining module is used for determining the working state of virtual reality equipment connected with the vehicle;
the position determining module is used for determining the position of a target object in the vehicle if the working state of the virtual reality equipment is a target state, wherein the target object is an object wearing the virtual reality equipment, and the target state is used for representing the state that the virtual reality equipment outputs audio through a loudspeaker of the vehicle;
And the sound field adjusting module is used for adjusting the sound field in the vehicle according to the position of the target object in the vehicle.
9. An electronic device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any of claims 1 to 7 when the computer program is executed.
10. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the method according to any one of claims 1 to 7.
CN202310961608.XA 2023-07-28 2023-07-28 Sound field control method and device, electronic equipment and storage medium Pending CN116828384A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310961608.XA CN116828384A (en) 2023-07-28 2023-07-28 Sound field control method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310961608.XA CN116828384A (en) 2023-07-28 2023-07-28 Sound field control method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN116828384A true CN116828384A (en) 2023-09-29

Family

ID=88118641

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310961608.XA Pending CN116828384A (en) 2023-07-28 2023-07-28 Sound field control method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116828384A (en)

Similar Documents

Publication Publication Date Title
US20170349184A1 (en) Speech-based group interactions in autonomous vehicles
US8948414B2 (en) Providing audible signals to a driver
US20170054949A1 (en) In-vehicle camera system
CN110816368A (en) Control method, device and system for adjusting vehicle electric seat and storage medium
US11265669B2 (en) Electronic device, method and computer program
US20210329116A1 (en) Vehicular electronic device and operation method thereof
CN109484344A (en) Method and apparatus for the portable occupant's vehicle setting that is globalized
CN112455462B (en) Passenger cabin system
US20160212536A1 (en) Method for controlling sound output of wearable device and vehicle for carrying out the same
CN114194128A (en) Vehicle volume control method, vehicle, and storage medium
CN116828384A (en) Sound field control method and device, electronic equipment and storage medium
CN111752508A (en) Mobile terminal, method for projecting multiple vehicle-mounted screens by mobile terminal and vehicle-mounted projection system
CN113766057A (en) In-vehicle communication method, device and system and vehicle
CN111422150B (en) Vehicle voice broadcasting method and vehicle-mounted terminal
CN115195643A (en) Control method, device and equipment of cabin entertainment system
CN113365201B (en) Sound effect adjusting method and device, electronic equipment and storage medium
CN115817395A (en) Self-adaptive control method and control terminal for optimal listening position in vehicle and vehicle
CN116700657A (en) Method and device for adjusting sound field of in-car audio and car
US11887385B2 (en) Camera-based in-cabin object localization
CN111669542B (en) Vehicle management system
CN117998273A (en) Sound field control method and device, electronic equipment and storage medium
US12095828B2 (en) In-vehicle communications and media mixing
EP4207767A1 (en) In-vehicle multi-occupant media management
US11921915B2 (en) Head-mounted display system and manned device
CN112738447B (en) Video conference method based on intelligent cabin and intelligent cabin

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20240118

Address after: No. 13 Xingxiang Road, Zengjia Town, High tech Zone, Shapingba District, Chongqing, 400039

Applicant after: Chongqing Selis Phoenix Intelligent Innovation Technology Co.,Ltd.

Address before: 401120 No. 618 Liangjiang Avenue, Longxing Town, Yubei District, Chongqing City

Applicant before: Chongqing Celes New Energy Automobile Design Institute Co.,Ltd.

TA01 Transfer of patent application right