CN113771703A - Automobile copilot seat adjusting method and system - Google Patents
Automobile copilot seat adjusting method and system Download PDFInfo
- Publication number
- CN113771703A CN113771703A CN202110874258.4A CN202110874258A CN113771703A CN 113771703 A CN113771703 A CN 113771703A CN 202110874258 A CN202110874258 A CN 202110874258A CN 113771703 A CN113771703 A CN 113771703A
- Authority
- CN
- China
- Prior art keywords
- seat
- passenger
- image
- sound
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 238000012545 processing Methods 0.000 claims description 52
- 230000004438 eyesight Effects 0.000 claims description 33
- 230000009471 action Effects 0.000 claims description 15
- 230000008569 process Effects 0.000 claims description 15
- 239000000284 extract Substances 0.000 claims description 5
- 230000016776 visual perception Effects 0.000 abstract description 3
- 238000011161 development Methods 0.000 description 5
- 230000018109 developmental process Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 230000000007 visual effect Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000001914 filtration Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 230000009191 jumping Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000011218 segmentation Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- SAZUGELZHZOXHB-UHFFFAOYSA-N acecarbromal Chemical compound CCC(Br)(CC)C(=O)NC(=O)NC(C)=O SAZUGELZHZOXHB-UHFFFAOYSA-N 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000003709 image segmentation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000002203 pretreatment Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 230000001131 transforming effect Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60N—SEATS SPECIALLY ADAPTED FOR VEHICLES; VEHICLE PASSENGER ACCOMMODATION NOT OTHERWISE PROVIDED FOR
- B60N2/00—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles
- B60N2/02—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles the seat or part thereof being movable, e.g. adjustable
- B60N2/0224—Non-manual adjustments, e.g. with electrical operation
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
Abstract
The invention provides a method and a system for adjusting automobile copilot, which can acquire information of passengers on a copilot seat through visual perception, judge whether to adjust the seat, and enable the passengers holding large articles to adjust the seat under the condition of no free hands through a voice system mobile phone passenger instruction.
Description
Technical Field
The invention relates to the technical field of artificial intelligence, in particular to a method and a system for adjusting a passenger seat of an automobile.
Background
With the great popularity of automobiles, ride comfort has become one aspect of vehicle selection. After the rapid development of the vehicle-mounted entertainment information system, people hope to more fully utilize the space in the vehicle, and better requirements are provided for adjusting the space in the vehicle. The electronic development of the seat in the cabin can help a vehicle owner to manually adjust the position of the seat to a great extent, and the problem of adjusting the space in the vehicle is solved to a certain extent. Sometimes, however, the vehicle owner does not have the condition to manually adjust the seat, or more hopes that the vehicle will intelligently remind, and the adjustment function can be completed through simple conversation, so that both hands are liberated. The development of artificial intelligence enables the technology to be realized, and the adjustment of the seat of the driver seat can be completed through image recognition and voice interaction.
Disclosure of Invention
This section is for the purpose of summarizing some aspects of embodiments of the invention and to briefly introduce some preferred embodiments. In this section, as well as in the abstract and the title of the invention of this application, simplifications or omissions may be made to avoid obscuring the purpose of the section, the abstract and the title, and such simplifications or omissions are not intended to limit the scope of the invention.
Therefore, the technical problem to be solved by the present invention is to overcome the defect that the passenger seat of the car in the prior art cannot be automatically adjusted under the condition that passengers are inconvenient, and to provide a method and a system for adjusting the passenger seat of the car based on visual and acoustic perception automatic adjustment.
In order to solve the technical problems, the invention provides the following technical scheme: a method for adjusting a passenger seat of an automobile is characterized by comprising the following steps: comprises that
Acquiring the information of a passenger seat, acquiring the image information of the passenger seat in the vehicle by a vision system, processing the image information into seat space parameters, and sending the seat space parameters to a master control system;
inquiring passengers, wherein the main control system judges whether the seats need to be adjusted according to the received seat space parameters, sends out inquiry sentences to the passengers through a sound system, collects voice instructions of the passengers and determines whether to send out adjustment action instructions to the seat system;
and (4) adjusting the seat, wherein the seat system executes the seat adjusting action according to the action adjusting instruction sent by the main control system until a user sends a stopping instruction or the visual system detects that the adjusting limit is reached, and the adjusting action is stopped.
As a preferable aspect of the method for adjusting a passenger seat of an automobile according to the present invention, wherein: and the image information of the passenger seat in the vehicle is acquired by an image acquisition module in the visual system.
As a preferable aspect of the method for adjusting a passenger seat of an automobile according to the present invention, wherein: the in-vehicle image acquisition module acquires image information on a co-driver seat, the image processing module processes the in-vehicle image with the image information of the machine, the image processing module delivers the in-vehicle image to the image recognition module to extract characteristic information, and the characteristic information is sent to the master control system.
As a preferable aspect of the method for adjusting a passenger seat of an automobile according to the present invention, wherein: and the main control system judges whether a large article is placed on the passenger seat or not according to the characteristic information sent by the vision system, and if so, the seat system is ready to be started to adjust the seat.
As a preferable aspect of the method for adjusting a passenger seat of an automobile according to the present invention, wherein: the image recognition module extracts the contour on the passenger seat in the image, and the master control system recognizes whether a large article is placed on the passenger seat according to the contour.
As a preferable aspect of the method for adjusting a passenger seat of an automobile according to the present invention, wherein: the main control system sends voice inquiry information to the sound system before the seat is adjusted, the sound playing module in the sound system plays the inquiry information to inquire whether the passenger needs to adjust the seat, and meanwhile, the sound collecting module in the sound system starts to collect the voice information of the passenger.
As a preferable aspect of the method for adjusting a passenger seat of an automobile according to the present invention, wherein: after the voice acquisition module acquires a voice instruction of a passenger, the voice processing module adjusts the voice instruction into a machine language and transmits the machine language to the voice recognition module, and the voice recognition module extracts a keyword and sends the keyword to the master control system as request information.
As a preferable aspect of the method for adjusting a passenger seat of an automobile according to the present invention, wherein: the master control system judges whether the passenger wants to adjust the seat or not according to the received request information; if so, the seat is adjusted backwards to increase the passenger space.
As a preferable aspect of the method for adjusting a passenger seat of an automobile according to the present invention, wherein: in the seat adjusting process, the vision system collects image information of the position of a front passenger seat, sends the processed image information to the main control system, judges whether the seat reaches the limit position or not, and stops seat adjustment if the seat reaches the limit position; the voice system collects voice information of a user, sends the voice information to the master control system, sends out adjustment stopping information when the master control system judges that a passenger sends out a stopping instruction, and stops adjusting the seat if the passenger sends out the stopping instruction.
The invention also provides a system for adjusting the automobile front passenger seat, which comprises
The vision system comprises an image acquisition module arranged in the vehicle, an image processing module and an image recognition module, wherein the image processing module and the image recognition module are used for processing, recognizing and acquiring image information;
the voice system comprises a voice acquisition module arranged in the vehicle, a voice processing module used for processing and recognizing voice information and a voice recognition module;
the main control system is connected with the visual system and the sound system and used for receiving and processing the information sent by the visual system and the sound system and sending a seat adjusting instruction to the seat system;
and the seat system is arranged on the seat, is connected with the main control system and is used for receiving and executing the seat adjusting instruction sent by the main control system.
The invention has the beneficial effects that: according to the method and the system for adjusting the automobile passenger seat, the information of the passenger on the passenger seat can be acquired through visual perception, whether the seat adjustment is needed or not is judged, and the passenger instruction is sent through the voice system mobile phone, so that the seat adjustment can be realized for the passenger holding a large article under the condition that no hand is available.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise. Wherein:
FIG. 1 is a structural view of a passenger seat adjusting system of an automobile in embodiment 2;
fig. 2 is a structural diagram of a main control system in embodiment 2;
FIG. 3 is a circuit diagram of a seat control circuit in embodiment 2;
FIG. 4 is a flowchart in example 3;
description of the reference numerals
100. A master control system; 200. a vision system; 300. a sound system; 400. seating system
101. A central processing unit; 102. a reservoir;
201. an image acquisition module; 202. an image processing module; 203. an image recognition module;
301. a sound collection module; 302. a sound processing module; 303. and a voice recognition module.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, but the present invention may be practiced in other ways than those specifically described and will be readily apparent to those of ordinary skill in the art without departing from the spirit of the present invention, and therefore the present invention is not limited to the specific embodiments disclosed below.
Furthermore, reference herein to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one implementation of the invention. The appearances of the phrase "in one embodiment" in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments.
Example 1
The embodiment provides a method for adjusting a passenger seat of an automobile, which comprises the steps of collecting passenger seat information, inquiring passengers and adjusting the seat.
When the information of the passenger seat is collected, the vision system 200 collects the image information of the passenger seat in the vehicle, processes the image information into the seat space parameter, and sends the seat space parameter to the main control system 100; the main control system 100 judges whether to adjust the seat according to the received seat space parameters, sends out inquiry sentences to the passengers through the sound system 300, collects voice instructions of the passengers, and determines whether to send out adjusting action instructions to the seat system 400; then the seat system 400 executes the seat adjusting action according to the action adjusting instruction sent by the main control system 100 until the user sends a stopping instruction or the vision system 200 detects that the adjusting limit is reached, and stops the adjusting action; the information of passengers on the passenger seat is acquired through visual perception, whether the seat adjustment is needed or not is judged, and the passenger instruction is sent through the sound system 300, so that the passengers holding large articles can adjust the seat under the condition that no hands are available.
In this embodiment, the image information of the passenger seat in the vehicle is acquired by the image acquisition module 201 in the vision system 200, the image acquisition module 201 in the vehicle acquires the image information on the passenger seat, and the image processing module 202 processes the image information of the vehicle with the image of the passenger seat, and then delivers the image information to the image recognition module 203 to extract the feature information, and sends the feature information to the main control system 100.
In the embodiment, the vision system 200 collects image information above or on the side of the passenger seat, processes the image information into a contour image through the image processing module 202 and the image recognition module 203, and sends the contour image to the main control system 100; the main control system 100 compares the characteristic information sent by the vision system 200 with the preset image of the large article, and judges whether the large article is placed on the front passenger seat or not by using an image algorithm; if a large article is placed, calculating the size of the space on the current passenger seat and comparing the size with a preset space threshold value, and if the space is smaller than the threshold value, preparing to start the seat system 400 to adjust the seat; if greater than the threshold, no adjustment is required.
Specifically, the image recognition process in this embodiment is as follows:
image loading, which loads image information acquired by the image acquisition module 201 of the vision system 200 into an image processing environment, such as an OPENCV vision library.
Correcting the image, detecting whether the image is abnormal or not, and selecting a reference original image; the reference original image in this embodiment may be provided in plural, and the image of the passenger seat acquired from different angles by the corresponding image acquisition module 201 is used as the reference original image.
Image processing, comprising:
1. graying the image, namely changing the color in the image into gray by adopting a weighted average method, wherein the gray in different areas is different;
2. image filtering, namely, suppressing noise in an image by using a median filtering method so as to improve the accuracy of a subsequent processing result;
3. performing image binarization, namely recording segmentation threshold values of an image I (x, y), a foreground (namely a target) and a background as T by using an OTSU algorithm, recording the proportion of the number of pixels belonging to the foreground in the whole image as omega 0, and recording the average gray level as mu 0; the proportion of the number of background pixels in the whole image is omega 1, and the average gray scale is mu 1; the average gray scale of the whole image is recorded as mu, and the inter-class variance is recorded as g.
Assuming that the image size is M × N, the number of pixels in the image having a gray level smaller than the threshold T is NO, and the number of pixels having a gray level larger than the threshold T is N1, the image size is M × N
ω0＝N0/M×N
ω1＝N1/M×N
N0+N1＝M×N
ω0+ω1＝1 (.
μ＝ω0＊μ0+ω1＊μ1
g＝ω0(μ0-μ)^2+ω1(μ1-μ)^2
g＝ω0ω1(μ0-μ1)^2 (
A threshold value T which enables the inter-class variance g to be maximum is adopted by a traversal method; and changing the part of the image with the gray level smaller than T into a background, and taking the part of the image with the gray level larger than T as a foreground to obtain a binary image.
4. Image segmentation, namely, sequentially using an image opening operation, an image closing operation and a binary negation method, mainly identifying three areas, namely a left side frame, a front windshield and a roof of a copilot, and finding out an interested area; since the brightness of the three areas is high during the day or low at night, the processed image can be easily distinguished from the article or passenger on the passenger seat, and thus can be more easily recognized.
And (4) processing a result: after obtaining the image processing result, the main control system 100 selects the inter-image pearson correlation coefficient, pixel and ratio to judge whether the three areas are greatly different from the original reference image due to the object shielding; if the passenger needs to adjust the seat, the main control system 100 judges that the passenger has a large article occupying space, if the passenger has the large article occupying space, the free space of the passenger at the moment is compared with a preset space threshold, and if the free space of the passenger is smaller than the space threshold, the main control system obtains a result that the seat needs to be adjusted, but the passenger needs to be inquired whether the seat needs to be adjusted before the result; if the confirmation answer of the passenger is obtained, the adjustment command is executed.
In the adjustment process, the vision system 200 keeps the state of the collected image all the time to determine that the collected image reaches the preset maximum spatial position, and the process is the same as the image recognition process, which is not described herein again.
Before the seat is adjusted, the main control system 100 sends voice query information to the sound system 300, the sound playing module in the sound system 300 plays the query information to query whether the passenger needs to adjust the seat, and simultaneously the sound collecting module 301 in the sound system 300 starts to collect the voice information of the passenger.
After the voice collecting module 301 collects the voice instruction of the passenger, the voice processing module 302 adjusts the voice instruction into a machine language and transmits the machine language to the voice recognition module 303, and the voice recognition module 303 extracts a keyword and sends the keyword as request information to the main control system 100.
Specifically, the speech recognition process is as follows:
pre-treatment, comprising:
1. the mute of the head and the tail ends is cut off, so that the interference to the subsequent steps is reduced;
2. sound is framed and cut into segments by a moving window function, each segment being called a frame, with overlap between frames.
Feature extraction: transforming each frame waveform into a multi-dimensional vector containing sound information by using Linear Prediction Cepstrum Coefficient (LPCC) and Mel cepstrum coefficient (MFCC) algorithms;
speech decoding and algorithm searching, comprising:
1. acoustic Model (AM): the method comprises the steps of training voice data to obtain the input characteristic vector and the output phoneme information;
2. loading a dictionary: establishing correspondence between characters or words and phonemes;
3. language Model (LM): training a large amount of text information to obtain the probability of correlation of single characters or words;
and (3) decoding: outputting characters to the audio data after the characteristics are extracted through an acoustic model, a dictionary and a language model;
and (4) judging the meaning: and judging the algorithm operation of the information obtained by decoding to obtain an execution command matched with the algorithm.
For example, after the voice system 300 in this embodiment receives the passenger's voice information "yes", the voice processing module 302 extracts the feature vector after adjusting the voice information, the voice recognition module 303 inputs the feature vector into the acoustic model to obtain the phoneme information, queries the phoneme information in a dictionary, and sends the matched text information "yes" as the request information to the main control system 100.
The main control system 100 matches the corresponding command as "adjust seat" according to the received request message "yes", and then sends a backward adjustment action command to the seat system 400.
During the adjustment of the seat system 400, the sound collection module 301 in the sound system 300 maintains the state of collecting the user's voice information. When the user says "stop" is collected, the master control system 100 sends an action instruction for stopping adjustment to the seat system 400, which is the same as the above method, so that the adjustment of the seat is completed.
In order to verify and explain the technical effect adopted in the method, the technical scheme of the voice-regulated automobile seat selected in the embodiment is compared with the method for testing, and the test result is compared by means of scientific demonstration to verify the real effect of the method.
The existing automobile seat adjusted through voice has not a good voice recognition effect, has a certain time delay, cannot recognize whether a user is inconvenient to move or not, and cannot be accurately adjusted, so that the user experience is not good.
In order to verify that the method can easily and quickly complete seat adjustment through a voice command relative to the technical scheme of adjusting the automobile seat by voice, in the embodiment, the existing technical scheme of adjusting the automobile seat by voice and the method are respectively used for experimental comparison of a passenger seat of a simulated vehicle.
Firstly, adjusting the automobile copilot by adopting the technical scheme of adjusting the automobile seat by voice, counting the time required by adjustment while speaking an instruction, and counting the adjustment condition after the adjustment is finished; then, the method is adopted to adjust the same seat, at the moment, the user does not carry large articles, the corresponding time and the adjusting condition are recorded after the adjustment is finished, and then the adjusting time and the adjusting condition when the user carries the large articles are recorded, wherein the large articles are cuboids of 50cm x 100 cm; the results are shown in the following table.
Table 1: the result comparison table of the same seat is adjusted by adopting the technical scheme of the method and the technical scheme of adjusting the automobile seat by voice respectively.
The above table shows that the seat adjusting effect of the method is better than the technical scheme of the existing voice adjusting automobile seat when the automobile seat is not carried with large articles, the method can carry out intelligent adjustment according to the size of the carried articles after the automobile seat is carried with the large articles, and the adjusting effect is still better than the technical scheme of the existing voice adjusting automobile seat.
Example 2
The embodiment provides an automobile front passenger seat adjusting system, the structure of which is shown in fig. 1, and the system comprises a vision system 200, an image processing module 202 and an image recognition module 203, wherein the vision system comprises an image acquisition module 201 arranged in an automobile, and the image processing module 202 and the image recognition module 203 are used for processing, recognizing and acquiring image information; the sound system 300 comprises a sound collection module 301 arranged in the vehicle, a sound processing module 302 used for processing and recognizing voice information and a sound recognition module 303; the main control system 100 is connected with the vision system 200 and the sound system 300, and is used for receiving and processing information sent by the vision system 200 and the sound system 300 and sending a seat adjusting instruction to the seat system 400; the seat system 400 is disposed on the seat, connected to the main control system 100, and configured to receive and execute a seat adjustment command sent by the main control system 100.
As shown in fig. 1, the vision system 200 in this embodiment includes an image acquisition module 201, an image processing module 202, and an image recognition module 203. The image acquisition module 201 is a camera arranged in the vehicle and detects image information on a passenger seat in the vehicle. And the image processing module 202 is used for converting the image information on the passenger seat into machine image information. And the image recognition module 203 is used for extracting the characteristic information in the machine image information.
Specifically, the image capturing module 201 in this embodiment is a CCD camera disposed in the vehicle, and captures a picture or a video of the passenger seat in the vehicle, and sends the captured result to the image processing module 202 in a data manner for processing. The image processing module 202 and the image recognition module 203 are integrated on the same single chip, and the same processor is responsible for executing operation. The image acquisition device in the vehicle can comprise a plurality of CCD cameras for acquiring environment pictures in different directions. The camera in this embodiment is preferably used for simultaneously collecting the front windshield, the a-pillar and the side window.
The main control system 100 in this embodiment includes a control system including a central processing unit 101, a receiving end, a transmitting end, and a memory, wherein the receiving end and the transmitting end are connected to a vision system 200 and a sound system 300; the receiving end and the transmitting end can be of PCI-E, SATA, I/O, AUX and other types; the information sent by the vision system 200200 and the sound system 300 is processed by the central processor 101 to obtain a control command for executing the action of the seat system 400; the main control module is specifically positioned on the traveling computer ECU and is powered by a vehicle-mounted power supply; the storage 102 is a vehicle-mounted hard disk and a random access memory, and is used for storing driving control system data and temporary data respectively.
In this embodiment, the sound system 300 includes a sound collection module 301, a sound processing module 302, a sound identification module 303, and a sound playing module; the sound collection module 301 is a microphone arranged in the vehicle, and the sound processing module 302 is used for performing operations such as filtering, noise reduction, segmentation and the like on collected voice information, so that original sound is changed into usable and calculated data; the sound recognition module 303 is configured to calculate the processed sound by using an acoustic model to obtain a meaning text.
The seat system 400 comprises a seat mounted on a passenger seat of the automobile, a track is laid below the seat, the seat is driven by a stepping motor to move linearly on the track, and a control circuit diagram of the seat system is shown in fig. 3. The stepping motor is connected with the programmable logic controller, and the working state of the stepping motor is controlled by the programmable logic controller. The programmable logic controller is connected to the main control system 100, and is configured to receive and execute a work instruction sent by the main control system 100.
In order to simplify the system of the present embodiment, the vision system 200 of the present embodiment is integrated on the central processing unit 101 of the main control system 100 and is located on the vehicle computer ECU except for the image capturing module 201 and the sound capturing module 301 of the sound system 300.
Alternatively, in order to achieve faster processing speed of the vision system 200 in this embodiment, the image processing module 202 and the image recognition module 203 in the vision system 200 in this embodiment may be implemented by graphics processing, and the graphics processing unit is located in the vehicle computer ECU together with the central processing unit 101.
Example 3
The present embodiment is based on the method and system for adjusting a passenger seat of an automobile as proposed in embodiment 1 and embodiment 2, and as shown in fig. 3, the following workflow is given:
step 1: the image acquisition module 201 constantly monitors whether the passenger seat needs to have a large object placed. If yes, executing the step 2, otherwise, continuing to execute the step 1 and monitoring the passenger seat.
Step 2: is the vision recognition module recognize that there is sufficient space in the copilot? If yes, go to step 10. Otherwise, executing step 3.
And step 3: and voice prompting whether to move the passenger seat backwards or not. Execution continues with step 4.
And 4, step 4: the sound system 300 listens for sounds and determines if there is a "yes" sound. If yes, go to step 6, otherwise, go to step 5.
And 5: determine if it is time out? If yes, jumping to step 10, otherwise, jumping to step 4.
Step 6: the voice playing module prompts ' stopping ' in the moving process '. Execution continues at step 7.
And 7: the sound system 300 listens for sounds and determines whether there is a "stop" sound. If yes, go to step 9. Otherwise, the process continues to step 8.
And 8: is the vision recognition module determined whether the rider has been unable to move any more? If yes, go to step 9. Otherwise, go to step 7.
And step 9: and finishing adjusting the copilot position. Execution continues at step 10.
Step 10: and (6) ending.
It is important to note that the construction and arrangement of the present application as shown in the various exemplary embodiments is illustrative only. Although only a few embodiments have been described in detail in this disclosure, those skilled in the art who review this disclosure will readily appreciate that many modifications are possible (e.g., variations in sizes, dimensions, structures, shapes and proportions of the various elements, values of parameters (e.g., temperatures, pressures, etc.), mounting arrangements, use of materials, colors, orientations, etc.) without materially departing from the novel teachings and advantages of the subject matter recited in this application. For example, elements shown as integrally formed may be constructed of multiple parts or elements, the position of elements may be reversed or otherwise varied, and the nature or number of discrete elements or positions may be altered or varied. Accordingly, all such modifications are intended to be included within the scope of this invention. The order or sequence of any process or method steps may be varied or re-sequenced according to alternative embodiments. In the claims, any means-plus-function clause is intended to cover the structures described herein as performing the recited function and not only structural equivalents but also equivalent structures. Other substitutions, modifications, changes and omissions may be made in the design, operating conditions and arrangement of the exemplary embodiments without departing from the scope of the present inventions. Therefore, the present invention is not limited to a particular embodiment, but extends to various modifications that nevertheless fall within the scope of the appended claims.
Moreover, in an effort to provide a concise description of the exemplary embodiments, all features of an actual implementation may not be described (i.e., those unrelated to the presently contemplated best mode of carrying out the invention, or those unrelated to enabling the invention).
It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions may be made. Such a development effort might be complex and time consuming, but would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill having the benefit of this disclosure, without undue experimentation.
It should be noted that the above-mentioned embodiments are only for illustrating the technical solutions of the present invention and not for limiting, and although the present invention has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions may be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, which should be covered by the claims of the present invention.
Claims (10)
1. A method for adjusting a passenger seat of an automobile is characterized by comprising the following steps: comprises that
Collecting the information of a passenger seat, collecting the image information of the passenger seat in the vehicle by a vision system (200), processing the image information into a seat space parameter, and sending the seat space parameter to a main control system (100);
inquiring passengers, wherein the main control system (100) judges whether to adjust the seats according to the received seat space parameters, sends inquiry sentences to the passengers through the sound system (300), collects voice instructions of the passengers and determines whether to send adjusting action instructions to the seat system (400);
and (4) adjusting the seat, wherein the seat system (400) executes the seat adjusting action according to the action adjusting command sent by the main control system (100) until a stopping command is sent by a user or the vision system (200) detects that the adjusting limit is reached, and the adjusting action is stopped.
2. The automobile front passenger seat adjusting method according to claim 1, characterized in that: the image information of the passenger seat in the vehicle is collected by an image collecting module (201) in the vision system (200).
3. The automobile front passenger seat adjusting method according to claim 2, characterized in that: the image acquisition module (201) in the vehicle acquires images of passengers on the passenger seats, the image processing module (202) processes image information of the image processing machine of the passengers in the vehicle, and then the image processing machine sends the image information to the image recognition module (203) to extract passenger characteristic information, and the passenger characteristic information is sent to the main control system (100).
4. The automobile front passenger seat adjusting method according to claim 3, characterized in that: the main control system (100) judges whether the passenger on the passenger seat holds a large article or not according to the passenger characteristic information sent by the vision system (200), and if so, the seat system (400) is ready to be started to adjust the seat.
5. The automobile front passenger seat adjusting method according to claim 4, characterized in that: the image recognition module (203) extracts the outline of the passenger in the image, and the master control system (100) recognizes whether the passenger holds a large article according to the outline.
6. The automobile front passenger seat adjustment method according to any one of claims 3, 4, and 5, characterized in that: the main control system (100) sends voice inquiry information to the sound system (300) before the seat is adjusted, a sound playing module in the sound system (300) plays the inquiry information to inquire whether a passenger needs to adjust the seat, and meanwhile, a sound collecting module (301) in the sound system (300) starts to collect the voice information of the passenger.
7. The automobile front passenger seat adjusting method according to claim 6, characterized in that: after voice command of passenger was gathered to sound collection module (301), sound processing module (302) will voice command adjusts and transmits to sound identification module (303) after for machine language, sound identification module (303) draw the keyword, will the keyword sends as request message to master control system (100).
8. The automobile front passenger seat adjusting method according to claim 7, characterized in that: the main control system (100) judges whether the passenger wants to adjust the seat according to the received request information; if so, the seat is adjusted backwards to increase the passenger space.
9. The automobile front passenger seat adjusting method according to claim 1, characterized in that: in the seat adjusting process, the vision system (200) collects image information of the position of a passenger seat, sends the processed image information to the main control system (100), judges whether the seat reaches the limit position, and stops seat adjustment if the seat reaches the limit position; the sound system (300) collects user voice information and sends the voice information to the main control system (100), the information of stopping adjustment is sent when the main control system judges that a passenger sends out a stop instruction, and the adjustment of the seat is stopped if the passenger sends out the stop instruction.
10. The utility model provides a car front passenger seat adjustment system which characterized in that: comprises that
The vision system (200) comprises an image acquisition module (201) arranged in the vehicle, an image processing module (202) and an image recognition module (203) for processing and recognizing acquired image information;
the sound system (300) comprises a sound collection module (301) arranged in the vehicle, a sound processing module (302) used for processing and recognizing voice information and a sound recognition module (303);
the master control system (100) is connected with the vision system (200) and the sound system (300) and is used for receiving and processing the information sent by the vision system (200) and the sound system (300) and sending a seat adjusting instruction to the seat system (400);
and the seat system (400) is arranged on the seat, is connected with the main control system (100) and is used for receiving and executing a seat adjusting instruction sent by the main control system (100).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110874258.4A CN113771703B (en) | 2021-07-30 | 2021-07-30 | Automobile co-driver seat adjusting method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110874258.4A CN113771703B (en) | 2021-07-30 | 2021-07-30 | Automobile co-driver seat adjusting method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113771703A true CN113771703A (en) | 2021-12-10 |
| CN113771703B CN113771703B (en) | 2024-03-26 |
Family
ID=78836666
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110874258.4A Active CN113771703B (en) | 2021-07-30 | 2021-07-30 | Automobile co-driver seat adjusting method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113771703B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115071632A (en) * | 2022-06-22 | 2022-09-20 | 中国第一汽车股份有限公司 | Safety belt guide plate position adjusting method and device and vehicle |
| CN115071632B (en) * | 2022-06-22 | 2024-04-16 | 中国第一汽车股份有限公司 | Safety belt guide plate position adjusting method and device and vehicle |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001199264A (en) * | 2000-01-20 | 2001-07-24 | Takashimaya Nippatsu Kogyo Co Ltd | Seat for vehicle |
| JP2006142855A (en) * | 2004-11-16 | 2006-06-08 | Mazda Motor Corp | Vehicle mounted with seat device |
| JP2009202738A (en) * | 2008-02-27 | 2009-09-10 | Aisin Aw Co Ltd | Vehicular seat position adjustment device, vehicular seat position adjustment method, and vehicular seat position adjustment program |
| US20110282495A1 (en) * | 2010-05-14 | 2011-11-17 | Brian Fischer | Modular seat actuation control system and communication method |
| CN109130965A (en) * | 2018-10-23 | 2019-01-04 | 长春汽富晟李尔汽车座椅系统有限公司 | Automotive seat intelligence control system and the automotive seat for using the system |
| CN110271506A (en) * | 2018-03-13 | 2019-09-24 | 蔚来汽车有限公司 | Method and apparatus for automatically adjusting vehicle seat |
| CN110843614A (en) * | 2019-11-30 | 2020-02-28 | 的卢技术有限公司 | Self-adaptive adjusting method and system for automobile seat |
| KR102135261B1 (en) * | 2019-05-09 | 2020-07-17 | 엘지전자 주식회사 | Autonomous driving vehicle control method |
| CN112026686A (en) * | 2019-06-04 | 2020-12-04 | 上海汽车集团股份有限公司 | Method and device for automatically adjusting position of vehicle seat |
| CN112248886A (en) * | 2020-10-30 | 2021-01-22 | 西南交通大学 | Automatic seat adjusting method |
-
2021
- 2021-07-30 CN CN202110874258.4A patent/CN113771703B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001199264A (en) * | 2000-01-20 | 2001-07-24 | Takashimaya Nippatsu Kogyo Co Ltd | Seat for vehicle |
| JP2006142855A (en) * | 2004-11-16 | 2006-06-08 | Mazda Motor Corp | Vehicle mounted with seat device |
| JP2009202738A (en) * | 2008-02-27 | 2009-09-10 | Aisin Aw Co Ltd | Vehicular seat position adjustment device, vehicular seat position adjustment method, and vehicular seat position adjustment program |
| US20110282495A1 (en) * | 2010-05-14 | 2011-11-17 | Brian Fischer | Modular seat actuation control system and communication method |
| CN110271506A (en) * | 2018-03-13 | 2019-09-24 | 蔚来汽车有限公司 | Method and apparatus for automatically adjusting vehicle seat |
| CN109130965A (en) * | 2018-10-23 | 2019-01-04 | 长春汽富晟李尔汽车座椅系统有限公司 | Automotive seat intelligence control system and the automotive seat for using the system |
| KR102135261B1 (en) * | 2019-05-09 | 2020-07-17 | 엘지전자 주식회사 | Autonomous driving vehicle control method |
| CN112026686A (en) * | 2019-06-04 | 2020-12-04 | 上海汽车集团股份有限公司 | Method and device for automatically adjusting position of vehicle seat |
| CN110843614A (en) * | 2019-11-30 | 2020-02-28 | 的卢技术有限公司 | Self-adaptive adjusting method and system for automobile seat |
| CN112248886A (en) * | 2020-10-30 | 2021-01-22 | 西南交通大学 | Automatic seat adjusting method |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115071632A (en) * | 2022-06-22 | 2022-09-20 | 中国第一汽车股份有限公司 | Safety belt guide plate position adjusting method and device and vehicle |
| CN115071632B (en) * | 2022-06-22 | 2024-04-16 | 中国第一汽车股份有限公司 | Safety belt guide plate position adjusting method and device and vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113771703B (en) | 2024-03-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110047487B (en) | Wake-up method and device for vehicle-mounted voice equipment, vehicle and machine-readable medium | |
| CN112397065A (en) | Voice interaction method and device, computer readable storage medium and electronic equipment | |
| US10431221B2 (en) | Apparatus for selecting at least one task based on voice command, vehicle including the same, and method thereof | |
| JP6964044B2 (en) | Learning device, learning method, program, trained model and lip reading device | |
| JP2022028772A (en) | In-vehicle device for analyzing voice production based on audio data and image data, method for processing voice production, and program | |
| CN110460921A (en) | A kind of pick-up control method, device, vehicle and storage medium | |
| CN109302486B (en) | Method and system for pushing music according to environment in vehicle | |
| Ivanko et al. | RUSAVIC Corpus: Russian audio-visual speech in cars | |
| KR20230118089A (en) | User Speech Profile Management | |
| CN110767228B (en) | Sound acquisition method, device, equipment and system | |
| US10289919B2 (en) | Vehicle and method of controlling the same | |
| CN113771703B (en) | Automobile co-driver seat adjusting method and system | |
| US20140168058A1 (en) | Apparatus and method for recognizing instruction using voice and gesture | |
| JPH11352987A (en) | Voice recognition device | |
| CN113407758A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN113535308A (en) | Language adjusting method, language adjusting device, electronic equipment and medium | |
| CN112519652A (en) | Method, device, equipment and medium for controlling telescopic cup bracket in vehicle | |
| CN113879235A (en) | Method, system, equipment and storage medium for multi-screen control of automobile | |
| WO2020048778A1 (en) | Method for controlling a multimedia device, and computer program and device therefor | |
| Libal et al. | An embedded system for in-vehicle visual speech activity detection | |
| CN115312061A (en) | Voice question-answer method and device in driving scene and vehicle-mounted terminal | |
| CN111724786A (en) | Lip language identification system and method | |
| JP7100575B2 (en) | Information processing equipment and programs | |
| CN117116268A (en) | Speech recognition method, device, electronic equipment and readable storage medium | |
| US20230290342A1 (en) | Dialogue system and control method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |