CN112835661A - On-board auxiliary system, vehicle comprising same, and corresponding method and medium - Google Patents
On-board auxiliary system, vehicle comprising same, and corresponding method and medium Download PDFInfo
- Publication number
- CN112835661A CN112835661A CN201911166350.4A CN201911166350A CN112835661A CN 112835661 A CN112835661 A CN 112835661A CN 201911166350 A CN201911166350 A CN 201911166350A CN 112835661 A CN112835661 A CN 112835661A
- Authority
- CN
- China
- Prior art keywords
- user
- vehicle
- related information
- language
- identity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/454—Multi-language systems; Localisation; Internationalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention relates to the field of vehicle technologies, and more particularly, to a vehicle-mounted assistance system, a vehicle including the vehicle-mounted assistance system, and a corresponding method and computer-readable storage medium for resetting a display language on a vehicle-mounted display device. The vehicle-mounted auxiliary system comprises: the device comprises at least one information acquisition unit, a judgment unit and an execution unit. By using the scheme of the invention, the display language on the vehicle-mounted display device can be automatically set for the user, or the user can conveniently and quickly select the display language on the vehicle-mounted display device, so that the user can safely, comfortably and fully use the vehicle, and the user experience is improved.
Description
Technical Field
The present invention relates to the field of vehicle technologies, and more particularly, to a vehicle-mounted assistance system, a vehicle including the vehicle-mounted assistance system, and a corresponding method and computer-readable storage medium for resetting a display language on a vehicle-mounted display device.
Background
In-vehicle displays have become a common configuration for modern vehicles. In addition to audio-visual entertainment, information display, backing assistance, and the like, the on-board display may also be used to set the vehicle, including volume settings, air conditioning temperature settings, navigation settings, and certain mechanical and electrical settings for the vehicle, especially for vehicles with a high degree of automation (e.g., electric vehicles).
On the other hand, sharing and leasing of vehicles are rapidly progressing globally, and users can conveniently lease and use vehicles abroad. For international rental vehicles, the greatest obstacle for the user may be that the user cannot find a "language setting" on the in-vehicle display full of foreign language text to set the language to the language he or she grasps/recognizes (especially in the case of the "language setting" option in the sub-menu), so that the user cannot use the rental vehicle safely, comfortably and fully.
Therefore, a technical solution for providing "language setting" for the user conveniently and quickly is needed.
Disclosure of Invention
In order to solve the technical problems, the invention provides a scheme for displaying a language setting menu for a user on a vehicle-mounted display according to identity related information and action related information of the user, and aims to conveniently and quickly provide the language setting menu for the user who faces strange languages and has no way of hands and feet, so that the user can safely, comfortably and fully use a rental car/international car.
Specifically, according to a first aspect of the present invention, there is provided an in-vehicle assist system including:
at least one information acquisition unit configured to acquire identity-related information and action-related information of a user;
a judging unit configured to judge whether or not a display language on the in-vehicle display device needs to be reset based on the identity-related information collected by the at least one information collecting unit and optionally further based on the action-related information collected by the at least one information collecting unit; and
and the execution unit is configured to automatically set the display language for the user according to the identity related information or enable the user to manually select the display language when the judgment unit judges that the display language on the vehicle-mounted display device needs to be reset.
In one embodiment, the at least one information acquisition unit comprises an image capturing unit configured for acquiring at least a facial image, a gaze action and an operation action of the user.
In one embodiment, the determination unit is configured to determine whether the user is a new user of the vehicle based on facial recognition of a facial image of the user, and when it is determined that the user is a new user of the vehicle, the determination unit is further configured to determine whether the display language on the in-vehicle display device needs to be reset based on whether a duration in which the user gazes at the in-vehicle display device exceeds a threshold and whether the user operates the in-vehicle display device.
In a preferred embodiment, the determination unit determines that the display language on the in-vehicle display device needs to be reset when the duration for which the user gazes at the in-vehicle display device exceeds a threshold value and the user does not perform any operation on the in-vehicle display device.
In one embodiment, the at least one information acquisition unit further includes an operation content detection unit configured to detect an operation of an operation interface of the in-vehicle display apparatus by a user.
In a further embodiment, the determination unit is configured to determine whether the user is a new user of the vehicle based on face recognition of a face image of the user, and when it is determined that the user is the new user of the vehicle, the determination unit is further configured to determine whether or not the display language on the in-vehicle display device needs to be reset based on a detection result of the operation content detection unit.
In a preferred embodiment, the determination unit determines that the display language on the in-vehicle display device needs to be reset when the operation content detection unit detects that the number of times or the time of the user's operation of the operation interface of the in-vehicle display device exceeds a threshold and no setting is changed.
In one embodiment, the system further comprises a storage unit storing at least a list of identity information of previous users of the vehicle, the determining unit being further configured to determine whether the current user is a new user of the vehicle based on a result of comparing the identity information of the current user with the list of identity information of previous users.
According to a second aspect of the invention, there is provided a vehicle comprising the on-board auxiliary system of the first aspect of the invention.
According to a third aspect of the present invention, there is provided a method of resetting a display language on an in-vehicle display apparatus, the method comprising the steps of:
collecting identity related information and action related information of a user;
determining whether a display language on the in-vehicle display device needs to be reset based on the identity-related information and optionally further based on the action-related information; and
and when the display language on the vehicle-mounted display device needs to be reset, automatically setting the display language for the user according to the identity related information or manually selecting the display language by the user.
In one embodiment, the collecting the identity-related information and the action-related information of the user comprises: at least facial images, gaze directions and operational actions of the user are captured.
In a further embodiment, the determining whether a display language on the in-vehicle display device needs to be reset based on the identity-related information and optionally further based on the action-related information comprises: whether the display language on the in-vehicle display device needs to be reset is determined based on performing facial recognition on a facial image of a user to determine whether the user is a new user of the vehicle, and further based on whether a duration of time for which the user gazes at the in-vehicle display device exceeds a threshold and whether the user operates the in-vehicle display device when it is determined that the user is a new user of the vehicle.
In a preferred embodiment, it is determined that the display language on the in-vehicle display device needs to be reset when the duration for which the user looks at the in-vehicle display device exceeds a threshold value and the user does not perform any operation on the in-vehicle display device.
In one embodiment, the collecting the identity-related information and the action-related information of the user further comprises: and detecting the operation of a user on an operation interface of the vehicle-mounted display device.
In a further embodiment, the determining whether a display language on the in-vehicle display device needs to be reset based on the identity-related information and optionally further based on the action-related information comprises: whether the user is a new user of the vehicle is determined based on face recognition of a face image of the user, and when it is determined that the user is a new user of the vehicle, it is further determined whether it is necessary to reset a display language on the in-vehicle display apparatus based on a detection result.
In a preferred embodiment, when it is detected that the number of times or the time of the user's operation of the operation interface of the in-vehicle display apparatus exceeds a threshold value and no setting is changed, it is determined that the display language on the in-vehicle display apparatus needs to be reset.
In one embodiment, the method further comprises determining whether the current user is a new user of the vehicle based on a result of the comparison of the identity information of the current user and the list of identity information of previous users.
According to a fourth aspect of the invention, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, carries out the method of the third aspect of the invention.
By using the scheme of the invention, the user can conveniently and quickly set the recognizable language on the vehicle-mounted display device under the condition that the default language of the vehicle-mounted display device of the rental vehicle is the language which can not be distinguished by the user, so that the user can safely, comfortably and fully use the vehicle and the user experience is improved.
Drawings
Non-limiting and non-exhaustive embodiments of the present invention are described by way of example with reference to the following drawings, in which:
FIG. 1 illustrates an exemplary graphical user interface of an in-vehicle display device according to the prior art;
FIG. 2 shows a schematic diagram of an on-board auxiliary system according to an embodiment of the invention;
FIG. 3 shows a schematic view of an on-board auxiliary system according to a further embodiment of the invention;
FIG. 4 shows a schematic view of an on-board auxiliary system according to yet another embodiment of the invention; and
fig. 5 is a schematic diagram illustrating a method of resetting a display language on an in-vehicle apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the application in any way.
Fig. 1 illustrates an exemplary display interface of an in-vehicle display according to the related art.
The figure shows an exemplary korean display interface on an in-vehicle display. While most systems have language switching and setting options, in general, most systems generally place the "language setting" menu under submenus (e.g., general- > set- > language setting), which makes it very difficult for users who cannot recognize the currently displayed language (e.g., korean) to find the "language setting" menu among many options, many hierarchical options. In this case, the user either has no trouble with such a display interface or has to carelessly and disorderly press the individual display buttons, which is often futile. Even further, some inadvertent settings can cause inconvenience, discomfort, or even danger to the user in driving thereafter.
The present invention solves these problems by providing an in-vehicle assistance system that automatically sets a display language for a user on an in-vehicle display device or enables the user to manually select the display language based on identity-related information, motion-related information of the user, a vehicle including the in-vehicle assistance system, and a corresponding method and computer-readable storage medium.
FIG. 2 shows a schematic diagram of an on-board auxiliary system 100 according to one embodiment of the invention.
As shown, an exemplary in-vehicle assistance system 100 according to one embodiment of the present invention includes: at least one information acquisition unit 200, a judgment unit 300 and an execution unit 400.
The at least one information collecting unit 200 is configured to collect identity related information and action related information of the user. In this context, the "identity-related information" mainly refers to information that can help to confirm the identity of the user, such as a human face, a fingerprint, a pupil, a login account number, even an identity card (e.g., an identity card number, nationality) or passport information (e.g., a passport number, nationality), and so on, but is not limited thereto. Herein, the "motion-related information" includes a user's gaze motion (such as gaze direction, gaze duration), an operation of an operation interface of the in-vehicle display apparatus (to change, for example, settings of navigation, radio, online connection, and the like), but is not limited thereto. In this context, the "operation interface" may be a key, a touch screen, a knob, etc. associated with the in-vehicle display device, which may be located near the center control screen, in the area of the center control screen, near the steering wheel, near the dashboard, etc.
The determination unit 300 is configured to determine whether or not a display language on the in-vehicle display device needs to be reset based on the identity-related information collected by the at least one information collection unit 200. At this time, the identity-related information may include, for example, nationality information obtained from an identity card or passport, or identity information of a previous user. Further, the determination unit 300 is further configured to determine whether or not the display language on the in-vehicle display device needs to be reset based on the identity-related information and the action-related information collected by the at least one information collection unit 200. At this time, the identity-related information may include, for example, identity information of the new user, and the motion-related information includes, for example, a user's gaze motion such as gaze direction, gaze duration, operation of an operation interface of the in-vehicle display apparatus (to change, for example, settings of navigation, radio, online connection, and the like).
As used herein, "in-vehicle display device" refers to any type of display device disposed within a vehicle, including in-vehicle displays, that may be used for audiovisual entertainment, information display, backup assistance, and/or vehicle settings, including volume settings, setting air conditioning temperature, navigation settings, and certain mechanical and electrical settings for the vehicle. The vehicle-mounted display can be a touch display or a non-touch display.
The execution unit 400 is configured to automatically set a display language for a user according to the identity-related information or enable the user to manually select the display language when the determination unit 300 determines that the display language on the in-vehicle display apparatus needs to be reset.
As an example, if the user is found to be, for example, a chinese nationality through the at least one information collection unit 200 (for example, through an identification card or a passport), the judgment unit 300 judges that the display language on the in-vehicle display apparatus needs to be reset in a case where the current display language on the in-vehicle display apparatus is not a chinese language, and the execution unit 400 automatically sets the display language for the user to a chinese language on the in-vehicle display apparatus according to the identity-related information that the user is a chinese nationality.
As another example, a preliminary determination may be made based on the identity-related information of the user collected by the at least one information collection unit 200, for example, a preliminary determination may be made as to whether the user is a new user or a previous user. If the user is found to be a previous user of the vehicle, the determination unit 300 determines that the display language on the in-vehicle display apparatus needs to be reset in case that the current display language on the in-vehicle display apparatus is not the language that the user used, and the execution unit 400 automatically sets the display language on the in-vehicle display apparatus for the user to the language that the user used. Additionally, if the user is found to be a new user of the vehicle, the determination unit 300 further determines whether or not the display language on the in-vehicle display device needs to be reset based on the motion-related information of the user, and the execution unit 400 executes a corresponding function to cause the user to manually select the display language when it is determined that the display language on the in-vehicle display device needs to be reset. As an example of manually selecting a display language, a language setting menu may be automatically popped up on the in-vehicle display device by the execution unit 400 for the user to make a language selection in a case where the determination unit 300 determines that the display language on the in-vehicle display device needs to be reset. The pop-up language setting menu may include a plurality of languages, such as english, german, french, chinese, spanish, japanese, korean, arabic, etc., for the user to set the language. The kind of language included in the pop-up language setting menu may be different according to the system design and in consideration of market demand and target group.
Fig. 3 shows a schematic illustration of a vehicle auxiliary system 100 according to a further embodiment of the invention.
As shown, the in-vehicle assist system 100 includes: at least one information acquisition unit 200, a judgment unit 300, and an execution unit 400, and the at least one information acquisition unit 200 includes an image capture unit 500. The image capturing unit 500 is configured to capture at least a face image, a gaze action and an operation action of a user.
In one example, the image capturing unit 500 comprises a camera/camcorder/camera, for example. The camera/camcorder/camera may be provided within the vehicle, particularly in a location where images/frames/video about the user may be captured (e.g., on/around an in-vehicle display device, on the dashboard, on or around a rear-view mirror, etc.).
The image capturing unit 500 may be configured to capture an image/frame/video of an in-vehicle user, and the determining unit 300 may determine whether the user is a new user of the vehicle based on facial recognition of the image/frame/video of the in-vehicle user.
As one example, the image capturing unit 500 captures a facial image of a user, generates identity information of the user through facial recognition, and compares/matches the generated identity information with an identity information list stored in an online server or a memory. It is noted that the list of identity information referred to herein refers to a list of identity information of previous users of the vehicle. And if the generated identity information is not found in the identity information list of the previous user or is not matched with any identity information in the identity information list of the previous user, judging that the user is a new user. In case that the user is judged to be a new user, the generated new identity information may be stored in the identity information list of the previous user, whereby the system of the present invention may display a corresponding selection language selected/set by the user when the user uses the vehicle again. In addition, if the aforementioned identity information list of the previous user is stored in the memory, the vehicle-mounted assisting system 100 of the present invention may further include a storage unit, for example, the determining unit 300 of the vehicle-mounted assisting system 100 of the present invention includes a storage unit for storing the identity information list of the previous user of the own vehicle.
In this context, user identity information or identity information refers to a unique identifier of a user associated with facial recognition of the user's face, which may be letters, numbers, words, or any combination or code. As known to those skilled in the art, the facial features are usually unique, and through facial recognition, a unique user identifier can be generated according to the unique features of the face, so the technical details of generating the identity information of the user through facial recognition are not described herein.
It is worth mentioning that in addition to generating user identity information by facial recognition, user identity information may be generated in other ways, for example by means of a biometric sensor, for example by means of the output of a fingerprint sensor, a palm print sensor, an iris sensor, a voiceprint sensor, etc.
In the case where the user is determined to be a new user, the determination unit 300 needs to determine whether or not the display language on the in-vehicle display device needs to be reset further based on the gaze motion and the operation motion of the user. Herein, the "gaze direction and the gaze duration of the user are included in the" gaze action ", and the" operation action "refers to an operation of the operation interface of the in-vehicle display device by the user.
As one example, the determination unit 300 determines whether it is necessary to reset the display language on the in-vehicle display apparatus based on whether the duration for which the user gazes at the in-vehicle display apparatus exceeds a threshold and whether the user operates the in-vehicle display apparatus. As a preferred example, when the duration for which the user is looking at the in-vehicle display apparatus exceeds a threshold value and the user does not perform any operation on the in-vehicle display apparatus, the determination unit 300 determines that the display language on the in-vehicle display apparatus needs to be reset.
For example, when the image/frame/video captured by the image capturing unit 500 finds that the user is looking at the in-vehicle display apparatus for a long time (for example, 5 seconds or more than 5 seconds), but has not made any operation on the operation interface of the in-vehicle display apparatus all the time, which generally represents that the user may not be able to operate the in-vehicle display apparatus due to the presence of a language barrier, and may be laboriously studying the displayed interface (language). In this case, the determination unit 300 determines that the display language on the in-vehicle display device needs to be reset, and the execution unit 400 thereby executes a corresponding function, for example, by automatically popping up a language setting menu on the in-vehicle display device for the user to manually select the display language.
As described above, the present invention sets a threshold value for the duration of time that the user gazes at the in-vehicle display device, and when the duration of time that the user gazes at the in-vehicle display device exceeds the threshold value, the user is considered to be actually having difficulty or no trouble in setting the language, and the display language on the in-vehicle display device needs to be reset for the user. The purpose of setting this threshold is to distinguish between a general view of the in-vehicle display device by a language-handicapped user and a stare view by a language-handicapped user. The threshold time may be determined based on experimental statistics of the general user in such a situation, and may be, for example, 5 seconds or shorter or longer. The sight tracking algorithm and technique based on image processing technology (image capture) are mature in aspects of assisting disabled people in life, analyzing product advertising market influence, playing visual entertainment games and the like, and are not described in detail herein for the sake of clarity and not to obscure the present invention.
Fig. 4 shows a schematic view of an on-board auxiliary system 100 according to yet another embodiment of the invention.
As shown in the figure, the assistance system 100 includes at least one information acquisition unit 200, a determination unit 300, and an execution unit 300, the at least one information acquisition unit 200 includes the image capturing unit 500 and an operation content detection unit 600, and the operation content detection unit 600 is configured to detect an operation of an operation interface of the in-vehicle display apparatus by a user.
When facing an in-vehicle display device interface such as the korean display shown in fig. 1, the user tries to bring up/find a language setting menu in addition to staring at sight without going from the next hand. As mentioned above, this is hardly successful in the case where the language setting menu is designed in a secondary or sub-secondary menu, and the result of an unintended attempt is that the user may try many times and may not be able to change the current language setting. Accordingly, when the operation content detection unit 600 detects that the number of attempts to operate (to change, for example, navigation, radio, online connection, etc.) the operation interface of the in-vehicle display apparatus exceeds a certain number of times and/or the attempt time exceeds a certain time but the setting is not changed, the determination unit 300 may determine that the display language on the in-vehicle display apparatus needs to be newly set for the user. A threshold value may be set for the certain number of times or the certain time according to the hierarchy set by the system menu. For example, the deeper the language setting menu is set, the greater the number threshold or the time threshold may be set, and otherwise, the smaller may be set.
As an example, first, a face image of a user is acquired by the image capturing unit 500, and the determination unit 300 determines whether the user is a new user of the vehicle through face recognition. When it is confirmed that the user is a new user of the vehicle, the judgment unit 300 is further configured to determine whether or not the display language needs to be reset based on the detection result of the operation content detection unit 600.
As a preferred example, when the operation content detection unit 600 detects that the number of times or time of the user's operation on the operation interface of the in-vehicle display device exceeds a threshold value and no setting is changed, the determination unit 300 determines that the display language on the in-vehicle display device needs to be reset, and at this time, the execution unit 400 executes a corresponding function, such as automatically popping up a language setting menu on the in-vehicle display device, for the user to make a display language selection or setting.
According to the system provided by the invention, the display language can be reset for the user who cannot identify the current display language on the vehicle-mounted display device according to the identity related information and the action related information of the user, so that the preferred language of the user can be selected for vehicle setting/control.
According to a second aspect of the present invention, there is also provided a vehicle including the on-board auxiliary system according to the first aspect of the present invention.
According to a third aspect of the present invention, there is also provided a method of resetting a display language on an in-vehicle display device, the method corresponding to the system of the first aspect of the present invention. For example, fig. 5 shows a schematic diagram of a method of resetting a display language on an in-vehicle display device according to an embodiment of the present invention.
As shown in fig. 5, a method S100 of resetting a display language on an in-vehicle display device includes:
s200: collecting identity related information and action related information of a user;
s300: determining whether a display language on the in-vehicle display device needs to be reset based on the identity-related information and optionally further based on the action-related information; and
s400: and when the display language on the vehicle-mounted display device needs to be reset, automatically setting the display language for the user according to the identity related information or manually selecting the display language by the user.
It is to be understood that the features of the vehicle-mounted auxiliary system according to the first aspect of the present invention may lead to or represent features of a method for resetting a display language on the vehicle-mounted display device, and therefore, the method will not be described herein again.
The fourth aspect of the present invention also provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of any of the above. For example, the computer program, when executed by a processor, is capable of instructing the processor and/or the respective component to carry out the steps of: collecting identity related information and action related information of a user; determining whether a display language on the in-vehicle display device needs to be reset based on the identity-related information and optionally further based on the action-related information; and when the display language on the vehicle-mounted display device needs to be reset, automatically setting the display language for the user according to the identity related information, or enabling the user to manually select the display language.
Further, it should be understood that the respective units in the in-vehicle assistance system 100 of the first aspect of the invention may be realized in whole or in part by software, hardware, and a combination thereof. The units can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the units.
In an embodiment, a computer device is provided, comprising a memory and a processor, the memory having stored thereon a computer program operable on the processor, the processor implementing the steps of the method in any of the above embodiments when executing the computer program. The computer device may be a server or a vehicle-mounted terminal. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement the method of resetting the display language on the in-vehicle display apparatus of the present invention.
It will be understood by those skilled in the art that the schematic diagrams of the in-vehicle assistance system 100 shown in fig. 2-4 are only block diagrams of a portion of the structure associated with the present application, and do not constitute a limitation on the computer device to which the present application is applied, and a particular computer device may include more or less components than shown in the figures, or combine certain components, or have a different arrangement of components.
It will be understood by those skilled in the art that all or part of the steps in implementing the methods according to the above embodiments of the present invention may be instructed to be performed by the relevant hardware by a computer program, which may be stored in a non-volatile computer-readable storage medium, and which, when executed, may include the steps of the above embodiments of the methods. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
While the present invention has been described in connection with the embodiments, it is to be understood by those skilled in the art that the foregoing description and drawings are merely illustrative and not restrictive of the broad invention, and that this invention not be limited to the disclosed embodiments. Various modifications and variations are possible without departing from the spirit of the invention.
Claims (14)
1. An on-board auxiliary system comprising:
at least one information acquisition unit configured to acquire identity-related information and action-related information of a user;
a judging unit configured to judge whether or not a display language on the in-vehicle display device needs to be reset based on the identity-related information collected by the at least one information collecting unit and optionally further based on the action-related information collected by the at least one information collecting unit; and
and the execution unit is configured to automatically set the display language for the user according to the identity related information or enable the user to manually select the display language when the judgment unit judges that the display language on the vehicle-mounted display device needs to be reset.
2. The system of claim 1, wherein the at least one information acquisition unit comprises an image capture unit configured to acquire at least a facial image, a gaze action, and an operational action of a user.
3. The system according to claim 2, wherein the judging unit is configured to determine whether the user is a new user of the vehicle based on face recognition of a face image of the user, and when it is determined that the user is the new user of the vehicle, the judging unit is further configured to determine whether it is necessary to reset the display language on the in-vehicle display apparatus based on whether a duration for which the user gazes at the in-vehicle display apparatus exceeds a threshold value and whether the user operates the in-vehicle display apparatus;
preferably, the determination unit determines that the display language on the in-vehicle display apparatus needs to be reset when a duration for which the user gazes at the in-vehicle display apparatus exceeds a threshold value and the user does not perform any operation on the in-vehicle display apparatus.
4. The system according to claim 2, wherein the at least one information acquisition unit further comprises an operation content detection unit configured to detect an operation of an operation interface of the in-vehicle display device by a user.
5. The system according to claim 4, wherein the judging unit is configured to determine whether the user is a new user of the vehicle based on face recognition of a face image of the user, and when it is determined that the user is the new user of the vehicle, the judging unit is further configured to determine whether or not the display language on the in-vehicle display device needs to be reset based on a detection result of the operation content detecting unit;
preferably, the determination unit determines that the display language on the in-vehicle display apparatus needs to be reset when the operation content detection unit detects that the number of times or the time of the user's operation on the operation interface of the in-vehicle display apparatus exceeds a threshold and the setting is not changed.
6. The system of claim 3 or 5, further comprising a storage unit storing at least a list of identity information of previous users of the vehicle, wherein the determining unit is further configured to determine whether the current user is a new user of the vehicle based on a comparison of the identity information of the current user and the list of identity information of previous users.
7. A vehicle comprising an on-board auxiliary system according to any one of claims 1-6.
8. A method of resetting a display language on an in-vehicle display device, the method comprising the steps of:
collecting identity related information and action related information of a user;
determining whether a display language on the in-vehicle display device needs to be reset based on the identity-related information and optionally further based on the action-related information; and
and when the display language on the vehicle-mounted display device needs to be reset, automatically setting the display language for the user according to the identity related information or manually selecting the display language by the user.
9. The method of claim 8, wherein collecting identity-related information and action-related information of a user comprises: at least facial images, gaze directions and operational actions of the user are captured.
10. The method of claim 9, wherein determining whether a display language on an in-vehicle display device needs to be reset based on the identity-related information and optionally further based on the action-related information comprises: determining whether or not a display language on an in-vehicle display apparatus needs to be reset based on performing facial recognition on a facial image of a user to determine whether or not the user is a new user of a vehicle, and further based on whether or not a duration for which the user gazes at the in-vehicle display apparatus exceeds a threshold and whether or not the user operates the in-vehicle display apparatus when it is determined that the user is a new user of a vehicle;
preferably, when it is detected that the duration for which the user gazes at the in-vehicle display apparatus exceeds a threshold value and the user does not perform any operation on the in-vehicle display apparatus, it is determined that the display language on the in-vehicle display apparatus needs to be reset.
11. The method of claim 9, wherein collecting identity-related information and action-related information of a user further comprises: an operation of an operation interface of the in-vehicle display device by a user is detected.
12. The method of claim 11, wherein determining whether a display language on an in-vehicle display device needs to be reset based on the identity-related information and optionally further based on the action-related information comprises: determining whether the user is a new user of the vehicle based on face recognition of a face image of the user, and when it is determined that the user is the new user of the vehicle, determining whether it is necessary to reset a display language on the in-vehicle display apparatus further based on a detection result;
preferably, when it is detected that the number of times or time of the user's operation of the operation interface of the in-vehicle display apparatus exceeds a threshold value and no setting is changed, it is determined that the display language on the in-vehicle display apparatus needs to be reset.
13. The method of claim 10 or 12, further comprising determining whether the current user is a new user of the vehicle based on a comparison of the identity information of the current user and the list of identity information of previous users.
14. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method of any one of claims 8 to 13.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911166350.4A CN112835661A (en) | 2019-11-25 | 2019-11-25 | On-board auxiliary system, vehicle comprising same, and corresponding method and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911166350.4A CN112835661A (en) | 2019-11-25 | 2019-11-25 | On-board auxiliary system, vehicle comprising same, and corresponding method and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112835661A true CN112835661A (en) | 2021-05-25 |
Family
ID=75922472
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911166350.4A Pending CN112835661A (en) | 2019-11-25 | 2019-11-25 | On-board auxiliary system, vehicle comprising same, and corresponding method and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112835661A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113535308A (en) * | 2021-07-27 | 2021-10-22 | 深圳市元征科技股份有限公司 | Language adjusting method, language adjusting device, electronic equipment and medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104509080A (en) * | 2012-08-01 | 2015-04-08 | 苹果公司 | Dynamic context-based language determination |
| CN107391122A (en) * | 2017-07-01 | 2017-11-24 | 珠海格力电器股份有限公司 | The method, apparatus and terminal of terminal system language are set |
| CN108182098A (en) * | 2017-12-07 | 2018-06-19 | 北京康力优蓝机器人科技有限公司 | Receive speech selection method, system and reception robot |
| CN109460270A (en) * | 2017-08-22 | 2019-03-12 | 微软技术许可有限责任公司 | The determination of language described in the member of social networks |
-
2019
- 2019-11-25 CN CN201911166350.4A patent/CN112835661A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104509080A (en) * | 2012-08-01 | 2015-04-08 | 苹果公司 | Dynamic context-based language determination |
| CN107391122A (en) * | 2017-07-01 | 2017-11-24 | 珠海格力电器股份有限公司 | The method, apparatus and terminal of terminal system language are set |
| CN109460270A (en) * | 2017-08-22 | 2019-03-12 | 微软技术许可有限责任公司 | The determination of language described in the member of social networks |
| CN108182098A (en) * | 2017-12-07 | 2018-06-19 | 北京康力优蓝机器人科技有限公司 | Receive speech selection method, system and reception robot |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113535308A (en) * | 2021-07-27 | 2021-10-22 | 深圳市元征科技股份有限公司 | Language adjusting method, language adjusting device, electronic equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10173687B2 (en) | Method for recognizing vehicle driver and determining whether driver can start vehicle | |
| JP6468883B2 (en) | Information processing apparatus, control method therefor, computer program, and recording medium | |
| EP3257436A1 (en) | User terminal and providing method therefor | |
| CN110481419B (en) | Human-vehicle interaction method, system, vehicle and storage medium | |
| CN109230927B (en) | Elevator control method, elevator control device, computer equipment and storage medium | |
| JP2006293909A (en) | Driver sight line direction detecting device | |
| US20160323503A1 (en) | Electronic device | |
| CN108804006B (en) | Unlocking method, device, equipment and storage medium for wearable equipment | |
| EP2833292A1 (en) | Programmable display apparatus, control method, and program | |
| CN112835661A (en) | On-board auxiliary system, vehicle comprising same, and corresponding method and medium | |
| JP2006312347A (en) | Command input device | |
| US20220256094A1 (en) | Method and System for Assisting a User Who is Looking at a Screen of a User Device | |
| JP6139719B1 (en) | Information processing device | |
| CN109710131B (en) | Information control method and device | |
| CN108088032B (en) | Control method and device of air conditioner | |
| CN115643483A (en) | Terminal equipment control method and device, readable storage medium and terminal equipment | |
| KR102458673B1 (en) | Artificial intelligence-based smart seat control method and apparatus therfore | |
| CN114882999A (en) | Physiological state detection method, device, equipment and storage medium | |
| CN113222809B (en) | Picture processing method and device for realizing privacy protection | |
| CN110809089B (en) | Processing method and processing apparatus | |
| CN109606314B (en) | Automobile control method and automobile | |
| CN111563456A (en) | Driving behavior early warning method and system | |
| TW201141735A (en) | Vehicle computer system with safe driving mechanism and operation method thereof | |
| CN114510193A (en) | Vehicle control method and device, vehicle and storage medium | |
| CN111753288B (en) | Application program function setting method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |