CN112168636B - In-vehicle vision improving device, equipment and system - Google Patents

In-vehicle vision improving device, equipment and system Download PDF

Info

Publication number
CN112168636B
CN112168636B CN202011014237.7A CN202011014237A CN112168636B CN 112168636 B CN112168636 B CN 112168636B CN 202011014237 A CN202011014237 A CN 202011014237A CN 112168636 B CN112168636 B CN 112168636B
Authority
CN
China
Prior art keywords
vision
vehicle
user
improvement
scheme
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011014237.7A
Other languages
Chinese (zh)
Other versions
CN112168636A (en
Inventor
丁磊
刘成军
郭凯华
吴青峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Human Horizons Shanghai Internet Technology Co Ltd
Original Assignee
Human Horizons Shanghai Internet Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Human Horizons Shanghai Internet Technology Co Ltd filed Critical Human Horizons Shanghai Internet Technology Co Ltd
Priority to CN202011014237.7A priority Critical patent/CN112168636B/en
Publication of CN112168636A publication Critical patent/CN112168636A/en
Application granted granted Critical
Publication of CN112168636B publication Critical patent/CN112168636B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H5/00Exercisers for the eyes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/02Subjective types, i.e. testing apparatus requiring the active assistance of the patient
    • A61B3/028Subjective types, i.e. testing apparatus requiring the active assistance of the patient for testing visual acuity; for determination of refraction, e.g. phoropters
    • A61B3/032Devices for presenting test symbols or characters, e.g. test chart projectors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/30ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H2205/00Devices for specific parts of the body
    • A61H2205/02Head
    • A61H2205/022Face
    • A61H2205/024Eyes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/011Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Theoretical Computer Science (AREA)
  • Medical Informatics (AREA)
  • General Engineering & Computer Science (AREA)
  • Epidemiology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Ophthalmology & Optometry (AREA)
  • Biophysics (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Surgery (AREA)
  • Primary Health Care (AREA)
  • Pain & Pain Management (AREA)
  • Rehabilitation Therapy (AREA)
  • Molecular Biology (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Rehabilitation Tools (AREA)

Abstract

The invention discloses a method, a device, equipment and a system for improving the vision in a vehicle, wherein the method comprises the following steps: responding to the condition that a preset in-vehicle vision improvement condition is met, and controlling to display a vision detection scheme for a user to perform vision detection to the in-vehicle user; controlling to send out a vision detection question corresponding to the vision detection scheme to a user in the vehicle; analyzing the vision condition of the user in the vehicle according to the vision detection answer result input by the user in the vehicle based on the vision detection question; acquiring a corresponding vision improvement scheme according to the analyzed vision condition of the user in the vehicle; and controlling the vision improvement scheme to be displayed to a user in the vehicle so as to enable the user to carry out vision improvement training according to the vision improvement scheme. The invention can improve the eyesight of the vehicle user and improve the driving safety.

Description

In-vehicle vision improving device, equipment and system
Technical Field
The invention relates to the technical field of vehicles, in particular to a method, a device, equipment and a system for improving the vision in a vehicle.
Background
At present, in the process of driving a vehicle for a long time, a vehicle user is easy to have blurred vision, even faded vision and other vision problems due to driving fatigue or over-use of eyes of the vehicle user for a long time, so that the vision of the vehicle user is influenced, the driving safety is influenced, and even serious traffic accidents of vehicle damage and death can occur.
Disclosure of Invention
The embodiment of the invention provides a method, a device, equipment and a system for improving the vision in a vehicle, which can improve the vision of a vehicle user and improve the driving safety.
An embodiment of the present invention provides a method for improving in-vehicle vision, including:
responding to the condition that a preset in-vehicle vision improvement condition is met, and controlling to display a vision detection scheme for a user to perform vision detection to the in-vehicle user;
controlling to send out a vision detection question corresponding to the vision detection scheme to a user in the vehicle;
analyzing the vision condition of the user in the vehicle according to the vision detection answer result input by the user in the vehicle based on the vision detection question;
acquiring a corresponding vision improvement scheme according to the analyzed vision condition of the user in the vehicle; the vision improvement scheme is preset, and the corresponding relation between the vision improvement scheme and the vision condition is preset;
and controlling the vision improvement scheme to be displayed to a user in the vehicle so as to enable the user to carry out vision improvement training according to the vision improvement scheme.
As an improvement of the above scheme, the controlling, in response to satisfaction of a preset in-vehicle vision improvement condition, to display, to a user in the vehicle, a vision inspection scheme for the user to perform vision inspection includes:
responding to the satisfaction of a preset in-vehicle vision improvement condition, and controlling to give a vision improvement prompt to a user in the vehicle;
and controlling to display a vision detection scheme for the user to perform vision detection to the user in the vehicle according to a vision improvement instruction input by the user in the vehicle based on the vision improvement prompt.
As an improvement of the above solution, the vision testing solution includes an eye chart, and the vision condition includes: and the myopia degree, wherein the vision improvement scheme comprises a myopia recovery training display model.
As an improvement of the above, the in-vehicle vision improvement condition includes one of:
the vehicle is in a parking state, and a user in the vehicle sends out a starting instruction of the eyesight improving function in the vehicle;
or, recognizing that the user in the vehicle is in a fatigue driving state and the vehicle is in a parking state.
As the improvement of above-mentioned scheme, the eyesight test scheme reaches the eyesight improvement scheme is passed through the interior VR wearing equipment of car and is shown, the eyesight test is asked questions through VR wearing equipment pronunciation is given out, the eyesight test answers the result and passes through in-car user speech input.
As an improvement of the above scheme, the vision detection scheme is displayed through a display screen of a vehicle, and the vehicle is provided with an electric seat; then, the controlling the display of the eyesight test solution for the user to perform eyesight test to the user in the vehicle in response to the satisfaction of the preset in-vehicle eyesight improvement condition includes:
in response to the satisfaction of a preset in-vehicle vision improvement condition, a seat adjustment prompt for adjusting the electric seat to a preset vision detection position is sent to a user in the vehicle, so that the user in the vehicle adjusts the electric seat to the preset vision detection position according to the seat adjustment prompt;
and controlling a display screen of the vehicle to display a vision detection scheme for the user to perform vision detection to the user in the vehicle.
As an improvement of the above, the method further comprises:
controlling an in-vehicle camera to shoot an in-vehicle user to obtain an in-vehicle user image;
carrying out face recognition on the in-vehicle user image, and acquiring facial features of the in-vehicle user; the facial features include: mouth and eye features;
judging whether the user in the vehicle is in a fatigue driving state or not according to the facial features;
and when the user in the vehicle is judged to be in the fatigue driving state, controlling to send fatigue driving warning to the user in the vehicle.
Another embodiment of the present invention correspondingly provides an apparatus for improving eyesight in a vehicle, which includes:
the first control module is used for responding to the satisfaction of a preset in-vehicle vision improvement condition and controlling the display of a vision detection scheme for the user to perform vision detection to the in-vehicle user;
the second control module is used for controlling sending of a vision detection question corresponding to the vision detection scheme to a user in the vehicle;
the vision condition analysis module is used for analyzing the vision condition of the user in the vehicle according to a vision detection answer result input by the user in the vehicle based on the vision detection question;
the acquisition module is used for acquiring a corresponding vision improvement scheme according to the analyzed vision condition of the user in the vehicle; the vision improvement scheme is preset, and the corresponding relation between the vision improvement scheme and the vision condition is established in advance;
and the third control module is used for controlling the vision improvement scheme to be displayed to a user in the vehicle so as to enable the user to carry out vision improvement training according to the vision improvement scheme.
Another embodiment of the present invention provides an in-vehicle vision improving system, including: customer premise equipment and in-vehicle vision improvement equipment;
the in-vehicle vision improving apparatus is configured to:
in response to the preset in-vehicle vision improvement condition being met, controlling the client equipment to display a vision detection scheme for the user to perform vision detection to the in-vehicle user;
controlling the user end equipment to send out a vision detection question corresponding to the vision detection scheme to a user in the vehicle;
analyzing the vision condition of the user in the vehicle according to the vision detection answer result input by the user in the vehicle based on the vision detection question;
acquiring a corresponding vision improvement scheme according to the analyzed vision condition of the user in the vehicle; wherein, the vision improvement scheme is preset, and the corresponding relation between the vision improvement scheme and the vision condition is pre-established;
and controlling the user side equipment to display the vision improvement scheme to the user in the vehicle.
Another embodiment of the present invention provides an in-vehicle vision improving apparatus, which includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, and when the processor executes the computer program, the in-vehicle vision improving apparatus implements the in-vehicle vision improving method according to the above embodiment of the present invention.
Compared with the prior art, one technical scheme in the embodiment of the invention has the following advantages:
when the preset in-vehicle vision improvement condition is met, the current vision condition of the in-vehicle user is indicated to be improved, and at the moment, the preset vision detection scheme is controlled to be displayed to the in-vehicle user for the user to carry out vision detection; and controlling to send out a vision detection question corresponding to the vision detection scheme to a user in the vehicle; analyzing the vision condition of the user in the vehicle according to the vision detection answer result input by the user in the vehicle based on the vision detection question; acquiring a corresponding vision improvement scheme according to the analyzed vision condition of the user in the vehicle; and controlling the vision improvement scheme to be displayed to the user in the vehicle so as to lead the user to carry out vision improvement training according to the vision improvement scheme, thereby improving the vision of the vehicle user, avoiding driving accidents caused by blurred vision and other vision problems of the vehicle user in the driving process and improving the driving safety. Of course, it is not necessary for any product in which the invention is practiced to achieve all of the above-described advantages at the same time.
Drawings
Fig. 1 is a schematic flow chart illustrating a method for improving vision in a vehicle according to an embodiment of the present invention;
FIG. 2 illustrates a data interaction process of an in-vehicle vision improvement method according to an embodiment of the present invention;
FIG. 3 illustrates a data interaction process of a method for improving vision in a vehicle according to another embodiment of the present invention;
FIG. 4 is a schematic flowchart of a fatigue driving state detection method according to another embodiment of the present invention;
FIG. 5 is a data interaction process of a fatigue driving state detection method according to an embodiment of the invention;
FIG. 6 is a schematic structural diagram of an in-vehicle vision improving apparatus according to an embodiment of the present invention;
FIG. 7 is a block diagram of an embodiment of an in-vehicle vision improvement system;
fig. 8 is a schematic structural diagram of an in-vehicle vision improving apparatus according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic flow chart of a method for improving the in-vehicle vision according to an embodiment of the present invention.
The method comprises the following steps:
s10, in response to the preset in-vehicle vision improvement condition being met, controlling to display a vision detection scheme for a user to perform vision detection to the in-vehicle user;
s11, controlling to send out a vision detection question corresponding to the vision detection scheme to a user in the vehicle;
s12, analyzing the vision condition of the user in the vehicle according to a vision detection answer result input by the user in the vehicle based on the vision detection question;
s13, acquiring a corresponding vision improvement scheme according to the analyzed vision condition of the user in the vehicle; the vision improvement scheme is preset, and the corresponding relation between the vision improvement scheme and the vision condition is preset;
and S14, controlling the vision improvement scheme to be displayed to a user in the vehicle so as to enable the user to carry out vision improvement training according to the vision improvement scheme.
By way of example, the method may be performed by an in-vehicle vision improvement device, where the device may be a main control apparatus of a vehicle (e.g., a vehicle gateway), a server of the vehicle, a user end device (e.g., a VR device, a smart phone), and the like, and is not limited in this respect. In the present embodiment, a main control device of a vehicle is described as an example of the execution subject of the method. The main control device of the vehicle establishes communication connection with a user end device (such as VR device). The vehicle is provided with in-vehicle vision improvement software and is operated by the main control device.
Specifically, referring to fig. 2 and 3, an in-vehicle user (for example, a driver or a passenger) turns on the in-vehicle vision improvement software and activates the in-vehicle vision improvement function, and a main control device of the vehicle issues an on prompt to the in-vehicle user in a manner of voice prompt (for example, a speaker of the vehicle issues a voice prompt to the in-vehicle user) or display prompt (for example, a prompt is displayed to the user through an in-vehicle display screen), so as to prompt the user to prepare for vision detection. When the main control device of the vehicle judges that the current in-vehicle vision improvement condition is met, the current vision condition of the in-vehicle user needs to be improved, and at the moment, the main control device sends a control instruction to the user side equipment to control the user side equipment to display a vision detection scheme for the in-vehicle user to perform vision detection. Meanwhile, the main control device sends out a vision detection question corresponding to the vision detection scheme to the user in the vehicle in a voice mode or a display mode so that the user in the vehicle answers the vision detection question according to the vision detection scheme seen by the user. The answering mode can be that the user in the vehicle inputs the eyesight test answering result by voice input or operation of the vehicle-mounted display screen and the like and sends the eyesight test answering result to the main control device. The main control device analyzes the vision condition of the user in the vehicle according to the answer result of the vision detection, for example, the main control device can analyze the myopia degree, the hyperopia degree, whether astigmatism exists or not of the user in the vehicle. The main control device obtains a corresponding and preset vision improvement scheme according to the analyzed vision condition of the user in the vehicle, for example, when the analyzed vision condition of the user in the vehicle is first-level myopia, the corresponding first-level myopia improvement scheme is obtained, if the analyzed vision condition is second-level myopia (the myopia degree is greater than the first-level myopia), the corresponding second-level myopia improvement scheme is obtained, or when the analyzed vision condition of the user in the vehicle is astigmatism, the corresponding astigmatism improvement scheme is obtained. And finally, the main control device controls the user side equipment to display the vision improvement scheme to the user in the vehicle, so that the user can perform vision improvement training according to the vision improvement scheme.
In conclusion, in the embodiment of the invention, when the preset in-vehicle vision improvement condition is met, it indicates that the current vision condition of the in-vehicle user needs to be improved, and at this time, the preset vision detection scheme is controlled to be displayed to the in-vehicle user for the user to perform vision detection; and controlling to send out a vision detection question corresponding to the vision detection scheme to a user in the vehicle; analyzing the vision condition of the user in the vehicle according to the vision detection answer result input by the user in the vehicle based on the vision detection question; acquiring a corresponding vision improvement scheme according to the analyzed vision condition of the user in the vehicle; and controlling the vision improvement scheme to be displayed to the vehicle user so as to enable the user to carry out vision improvement training according to the vision improvement scheme, thereby improving the vision of the vehicle user, avoiding driving accidents caused by blurred vision and other vision problems of the vehicle user in the driving process, and improving the driving safety.
Exemplarily, the step S10 includes:
s100, responding to the situation that a preset in-vehicle vision improvement condition is met, and controlling to give a vision improvement prompt to a user in the vehicle;
and S101, controlling to display a vision detection scheme for the user to perform vision detection to the user in the vehicle according to a vision improvement instruction input by the user in the vehicle based on the vision improvement prompt.
The vehicle-mounted user can be sent out a vision improvement prompt in a voice mode or a display mode. For example, the audio prompt for improving eyesight may be sent to the user in the vehicle through a speaker of the vehicle, or the display prompt for improving eyesight may be sent to the user in the vehicle through a vehicle-mounted display screen or a user end device.
By way of example, the vision testing protocol includes an eye chart, and the vision condition includes: and the myopia degree, wherein the vision improvement scheme comprises a myopia recovery training display model.
Specifically, customer premises equipment can be VR equipment, and the user wears VR equipment in the car, can show on VR equipment and have the simulation to be the not equidimension letter E of 1 meter distance and indicate the orientation that the user read out letter E in the car with the user in the car, then master control set comes according to the result of the orientation of the letter E that the user read out in the car, and the near-sighted number of degrees of user is analyzed out. In addition, as an example, visual training model animations for different degrees of myopia may be pre-made and stored in the main control device, and then the corresponding visual training animation is shown to the user for viewing according to the currently analyzed degree of myopia of the user in the vehicle, and the user in the vehicle is prompted to perform a corresponding eye training action according to the visual training animation.
For example, the in-vehicle vision improvement condition may include: the vehicle is in a parking state, and the user in the vehicle sends out an in-vehicle vision improving function starting instruction.
As another example, the in-vehicle vision improvement condition may be a condition including: it is recognized that the user in the vehicle is in a fatigue driving state and the vehicle is in a parking state. For example, a main control device of a vehicle controls an in-vehicle camera to shoot an in-vehicle user to obtain an in-vehicle user image; the main control device carries out face recognition on the in-vehicle user image and acquires the facial features of the in-vehicle user; the facial features include: mouth and eye features; then the main control device judges whether the user in the vehicle is in a fatigue driving state or not according to the facial features; if the user in the vehicle is judged to be in a fatigue driving state, it is indicated that the user in the vehicle may have eyesight problems such as poor eyesight and blurred eyesight, and at the moment, the eyesight of the user in the vehicle needs to be improved. Therefore, driving accidents caused by blurred vision and other vision problems of the vehicle user in the driving process can be avoided, and driving safety is improved. Specifically, when the analyzed mouth feature is larger than the preset mouth opening threshold, it is indicated that the driving fatigue state occurs due to yawning of the user in the vehicle, and accordingly, the eyesight problems such as non-concentration and the like may also occur to the eyesight of the user in the vehicle at the time; and when the eye characteristics are analyzed that the blinking times exceed a preset time threshold value or the closing degree of the eyelids is larger than a preset closing threshold value in a preset time period, the fact that the user in the vehicle is in a fatigue driving state and the current eyesight of the user in the vehicle has a problem is indicated.
For example, the vision testing scheme and the vision improvement scheme are displayed through a VR wearable device in the vehicle, the vision testing question is issued through voice of the VR wearable device, and the vision testing response result is input through voice of a user in the vehicle.
As another example, the vision test protocol is displayed via a display screen of a vehicle having a power seat; then, the controlling of displaying the eyesight test scheme for the user to perform eyesight test to the in-vehicle user in response to the preset in-vehicle eyesight improvement condition being satisfied includes:
in response to the satisfaction of a preset in-vehicle vision improvement condition, a seat adjustment prompt for adjusting the electric seat to a preset vision detection position is sent to a user in the vehicle, so that the user in the vehicle adjusts the electric seat to the preset vision detection position according to the seat adjustment prompt;
and controlling a display screen of the vehicle to display a vision detection scheme for the user to perform vision detection to the user in the vehicle.
In the present embodiment, when visual acuity improvement is required for a user in a vehicle, visual acuity test is performed by prompting the user to adjust a vehicle seat to a predetermined visual acuity test position.
Of course, when the preset in-vehicle vision improvement condition is satisfied, it may be: and controlling the electric seat to be adjusted to a preset vision detection position, and controlling a display screen of the vehicle to display a vision detection scheme for a user to perform vision detection to the user in the vehicle.
In the above embodiment, referring to fig. 4 and 5, the method further includes:
s20, controlling an in-vehicle camera to shoot an in-vehicle user to obtain an in-vehicle user image;
s21, carrying out face recognition on the in-vehicle user image, and acquiring the facial features of the in-vehicle user; the facial features include: mouth and eye features;
s22, judging whether the user in the vehicle is in a fatigue driving state or not according to the facial features;
specifically, when the analyzed mouth feature is larger than a preset mouth opening threshold, the driving fatigue state of the user in the vehicle caused by yawning is shown; and when the eye characteristics are analyzed that the number of winks exceeds a preset number threshold value or the degree of closure of the eyelids is greater than a preset closure threshold value in a preset time period, indicating that the user in the vehicle is in a fatigue driving state.
And S23, when the user in the vehicle is judged to be in a fatigue driving state, controlling to send a fatigue driving warning to the user in the vehicle.
Specifically, the fatigue driving warning can be sent to the user in the vehicle in a voice or display mode so as to warn the user in the vehicle to stop for rest. When the vehicle is detected to be stopped and in a flameout state, the in-vehicle user is indicated to be in a parking rest, and the detection of the fatigue driving state of the in-vehicle user can be stopped at the moment. Preferably, the in-vehicle user is a driver of the vehicle.
In the embodiment, the occurrence of vehicle safety accidents caused by fatigue driving is reduced by monitoring the fatigue driving state of the driver in real time.
In addition, in the above embodiment, the main control device of the vehicle may upload the condition of improving eyesight of the user in the vehicle and the monitoring condition of the fatigue driving state to the server of the vehicle for storage, so as to facilitate subsequent review, analysis and tracing.
Referring to fig. 6, a schematic structural diagram of an in-vehicle vision improving apparatus according to an embodiment of the present invention is shown, including:
the first control module 10 is used for responding to the satisfaction of a preset in-vehicle vision improvement condition and controlling the display of a vision detection scheme for the user to perform vision detection on the in-vehicle user;
the second control module 11 is used for controlling sending out a vision detection question corresponding to the vision detection scheme to a user in the vehicle;
the vision condition analysis module 12 is used for analyzing the vision condition of the user in the vehicle according to the vision detection answer result input by the user in the vehicle based on the vision detection question;
the obtaining module 13 is configured to obtain a corresponding eyesight improving scheme according to the analyzed eyesight condition of the user in the vehicle; wherein, the vision improvement scheme is preset, and the corresponding relation between the vision improvement scheme and the vision condition is pre-established;
and the third control module 14 is configured to control display of the eyesight improvement scheme to a user in the vehicle, so that the user performs eyesight improvement training according to the eyesight improvement scheme.
In the embodiment of the invention, when the preset in-vehicle vision improvement condition is met, the current vision condition of the in-vehicle user is indicated to be improved, and at the moment, the preset vision detection scheme is controlled to be displayed to the in-vehicle user for the user to carry out vision detection; and controlling to send out a vision detection question corresponding to the vision detection scheme to a user in the vehicle; analyzing the vision condition of the user in the vehicle according to the vision detection answer result input by the user in the vehicle based on the vision detection question; acquiring a corresponding vision improvement scheme according to the analyzed vision condition of the user in the vehicle; and controlling the vision improvement scheme to be displayed to the vehicle user so as to enable the user to carry out vision improvement training according to the vision improvement scheme, thereby improving the vision of the vehicle user, avoiding driving accidents caused by blurred vision and other vision problems of the vehicle user in the driving process, and improving the driving safety.
As an improvement of the above scheme, the first control module is specifically configured to:
responding to the satisfaction of a preset in-vehicle vision improvement condition, and controlling to send a vision improvement prompt to a user in the vehicle;
and controlling to display a vision detection scheme for the user to perform vision detection to the user in the vehicle according to a vision improvement instruction input by the user in the vehicle based on the vision improvement prompt.
As an improvement of the above, the vision testing scheme comprises an eye chart, and the vision condition comprises: and the myopia degree, and the vision improvement scheme comprises a myopia recovery training display model.
As an improvement of the above, the in-vehicle vision improvement condition includes one of:
the vehicle is in a parking state, and a user in the vehicle sends a starting instruction of the in-vehicle vision improving function;
or, it is recognized that the user in the vehicle is in a fatigue driving state and the vehicle is in a parking state.
As the improvement of above-mentioned scheme, the eyesight test scheme reaches the eyesight improvement scheme is passed through the interior VR wearing equipment of car and is shown, the eyesight test is asked questions through VR wearing equipment pronunciation is given out, the eyesight test answers the result and passes through in-car user speech input.
As an improvement of the above scheme, the vision detection scheme is displayed through a display screen of a vehicle, and the vehicle is provided with an electric seat; then, the first control module is specifically configured to:
in response to the fact that a preset in-vehicle vision improvement condition is met, a seat adjusting prompt for adjusting the electric seat to a preset vision detection position is sent to a user in the vehicle, so that the user in the vehicle can adjust the electric seat to the preset vision detection position according to the seat adjusting prompt;
and controlling a display screen of the vehicle to display a vision detection scheme for the user to perform vision detection to the user in the vehicle.
As an improvement of the above, the method further comprises:
the fourth control module is used for controlling the in-vehicle camera to shoot the in-vehicle user to obtain an in-vehicle user image;
the face recognition module is used for carrying out face recognition on the in-vehicle user image and acquiring the facial features of the in-vehicle user; the facial features include: mouth and eye features;
the fatigue driving state judging module is used for judging whether the user in the vehicle is in a fatigue driving state or not according to the facial features;
and the fifth control module is used for controlling to send out fatigue driving warnings to the users in the vehicle when the users in the vehicle are judged to be in the fatigue driving state.
Fig. 7 is a system architecture diagram of an in-vehicle vision improving system according to another embodiment of the present invention. The in-vehicle vision improving system includes: customer premises equipment 90 and in-vehicle vision improving equipment 91;
wherein the in-vehicle vision improving apparatus 91 is configured to:
in response to meeting a preset in-vehicle vision improvement condition, controlling the client device 90 to display a vision detection scheme for the user to perform vision detection to the in-vehicle user;
controlling the user end equipment 90 to send out a vision detection question corresponding to the vision detection scheme to a vehicle user;
analyzing the vision condition of the user in the vehicle according to the vision detection answer result input by the user in the vehicle based on the vision detection question;
acquiring a corresponding vision improvement scheme according to the analyzed vision condition of the user in the vehicle; the vision improvement scheme is preset, and the corresponding relation between the vision improvement scheme and the vision condition is established in advance;
and controlling the client device 90 to display the eyesight improvement scheme to the in-vehicle user.
It should be noted that, in the embodiment of the present invention, the related content of the in-vehicle vision improving system may refer to the scheme of the related embodiment of the in-vehicle vision improving method, and details are not repeated herein.
Fig. 8 is a schematic view of an in-vehicle vision improving apparatus according to an embodiment of the present invention. The in-vehicle vision improving apparatus of this embodiment includes: a processor 1, a memory 2 and a computer program, such as an in-vehicle vision improvement program, stored in said memory 2 and executable on said processor. The processor 1 implements the steps in the above-described respective embodiments of the in-vehicle vision improving method when executing the computer program. Alternatively, the processor implements the functions of the modules/units in the above device embodiments when executing the computer program.
Illustratively, the computer program may be partitioned into one or more modules/units, stored in the memory and executed by the processor, to implement the invention. The one or more modules/units may be a series of computer program instruction segments capable of performing certain functions, which are used to describe the execution of the computer program in the in-vehicle vision improving device.
The in-vehicle vision improving device can be a computing device such as an in-vehicle and cloud server. The in-vehicle vision improving device may include, but is not limited to, a processor, a memory. It will be appreciated by those skilled in the art that the schematic diagram is merely an example of an in-vehicle vision improving device and does not constitute a limitation of an in-vehicle vision improving device, and may include more or fewer components than shown, or some components may be combined, or different components, e.g., the in-vehicle vision improving device may also include input-output devices, network access devices, buses, etc.
The Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. The general purpose processor may be a microprocessor or the processor may be any conventional processor or the like, the processor is a control center of the in-vehicle vision improving apparatus, and various interfaces and lines are used to connect various parts of the entire in-vehicle vision improving apparatus.
The memory may be used to store the computer programs and/or modules, and the processor may implement the various functions of the in-vehicle vision improving apparatus by running or executing the computer programs and/or modules stored in the memory and calling up the data stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. In addition, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
Wherein, the module/unit integrated with the in-vehicle vision improvement device can be stored in a computer readable storage medium if it is implemented in the form of software functional unit and sold or used as an independent product. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U.S. disk, removable hard disk, magnetic diskette, optical disk, computer Memory, read-Only Memory (ROM), random Access Memory (RAM), electrical carrier wave signal, telecommunications signal, and software distribution medium, etc. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
It should be noted that the above-described device embodiments are merely illustrative, where the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. In addition, in the drawings of the embodiment of the apparatus provided by the present invention, the connection relationship between the modules indicates that there is a communication connection between them, and may be specifically implemented as one or more communication buses or signal lines. One of ordinary skill in the art can understand and implement without inventive effort.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.

Claims (9)

1. An in-vehicle vision improving device, comprising:
the first control module is used for responding to the satisfaction of a preset in-vehicle vision improvement condition and controlling the display of a vision detection scheme for the vision detection of a user to an in-vehicle user;
the second control module is used for controlling the in-vehicle user to send out a vision detection question corresponding to the vision detection scheme;
the vision condition analysis module is used for analyzing the vision condition of the user in the vehicle according to a vision detection answer result input by the user in the vehicle based on the vision detection question;
the acquisition module is used for acquiring a corresponding vision improvement scheme according to the analyzed vision condition of the user in the vehicle; the vision improvement scheme is preset, and the corresponding relation between the vision improvement scheme and the vision condition is established in advance;
and the third control module is used for controlling the vision improvement scheme to be displayed to a user in the vehicle so as to enable the user to carry out vision improvement training according to the vision improvement scheme.
2. An in-vehicle vision improvement system, comprising: customer premise equipment and in-vehicle vision improvement equipment;
the in-vehicle vision improving apparatus is configured to:
responding to the condition that a preset in-vehicle vision improvement condition is met, and controlling the client equipment to display a vision detection scheme for the user to perform vision detection to the in-vehicle user;
controlling the user side equipment to send out a vision detection question corresponding to the vision detection scheme to the vehicle user;
analyzing the vision condition of the user in the vehicle according to the vision detection answer result input by the user in the vehicle based on the vision detection question;
acquiring a corresponding vision improvement scheme according to the analyzed vision condition of the user in the vehicle; wherein, the vision improvement scheme is preset, and the corresponding relation between the vision improvement scheme and the vision condition is pre-established;
and controlling the user end equipment to display the vision improvement scheme to a user in the vehicle.
3. An in-vehicle vision improvement device comprising a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, the processor implementing a method of improving in-vehicle vision when executing the computer program;
the in-vehicle vision improvement method includes:
responding to the condition that a preset in-vehicle vision improvement condition is met, and controlling to display a vision detection scheme for a user to perform vision detection to the in-vehicle user;
controlling to send out a vision detection question corresponding to the vision detection scheme to a user in the vehicle;
analyzing the vision condition of the user in the vehicle according to the vision detection answer result input by the user in the vehicle based on the vision detection question;
acquiring a corresponding vision improvement scheme according to the analyzed vision condition of the user in the vehicle; the vision improvement scheme is preset, and the corresponding relation between the vision improvement scheme and the vision condition is preset;
and controlling the vision improvement scheme to be displayed to the user in the vehicle so as to enable the user to carry out vision improvement training according to the vision improvement scheme.
4. The in-vehicle vision improvement device according to claim 3, wherein said controlling, in response to satisfaction of a preset in-vehicle vision improvement condition, to display to an in-vehicle user a vision inspection scheme for vision inspection by the user includes:
responding to the satisfaction of a preset in-vehicle vision improvement condition, and controlling to send a vision improvement prompt to a user in the vehicle;
and controlling to display a vision detection scheme for the user to perform vision detection to the user in the vehicle according to a vision improvement instruction input by the user in the vehicle based on the vision improvement prompt.
5. The in-vehicle vision improvement device of claim 3, wherein said vision testing protocol comprises an eye chart, and said vision conditions comprise: and the myopia degree, wherein the vision improvement scheme comprises a myopia recovery training display model.
6. The in-vehicle vision improving apparatus according to claim 3, wherein the in-vehicle vision improving condition includes one of:
the vehicle is in a parking state, and a user in the vehicle sends a starting instruction of the in-vehicle vision improving function;
or, recognizing that the user in the vehicle is in a fatigue driving state and the vehicle is in a parking state.
7. The in-vehicle vision improvement device of claim 3, wherein the vision test protocol and the vision improvement protocol are displayed by a VR wearable device in a vehicle, the vision test question is uttered by voice by the VR wearable device, and the vision test answer result is input by a user in the vehicle by voice.
8. The in-vehicle vision improvement device of claim 3, wherein said vision test protocol is displayed via a display screen of a vehicle having a power seat; then, the controlling of displaying the eyesight test scheme for the user to perform eyesight test to the in-vehicle user in response to the preset in-vehicle eyesight improvement condition being satisfied includes:
in response to the fact that a preset in-vehicle vision improvement condition is met, a seat adjusting prompt for adjusting the electric seat to a preset vision detection position is sent to a user in the vehicle, so that the user in the vehicle can adjust the electric seat to the preset vision detection position according to the seat adjusting prompt;
and controlling a display screen of the vehicle to display a vision detection scheme for the user to perform vision detection to the user in the vehicle.
9. The in-vehicle vision improving apparatus of claim 3, wherein said method further comprises:
controlling an in-vehicle camera to shoot an in-vehicle user to obtain an in-vehicle user image;
carrying out face recognition on the in-vehicle user image, and acquiring the facial features of the in-vehicle user; the facial features include: mouth and eye features;
judging whether the user in the vehicle is in a fatigue driving state or not according to the facial features;
and when the user in the vehicle is judged to be in the fatigue driving state, controlling to send fatigue driving warning to the user in the vehicle.
CN202011014237.7A 2020-09-24 2020-09-24 In-vehicle vision improving device, equipment and system Active CN112168636B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011014237.7A CN112168636B (en) 2020-09-24 2020-09-24 In-vehicle vision improving device, equipment and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011014237.7A CN112168636B (en) 2020-09-24 2020-09-24 In-vehicle vision improving device, equipment and system

Publications (2)

Publication Number Publication Date
CN112168636A CN112168636A (en) 2021-01-05
CN112168636B true CN112168636B (en) 2023-02-03

Family

ID=73956565

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011014237.7A Active CN112168636B (en) 2020-09-24 2020-09-24 In-vehicle vision improving device, equipment and system

Country Status (1)

Country Link
CN (1) CN112168636B (en)

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2695021Y (en) * 2003-09-16 2005-04-27 梁平 Driver fatigue health-care instrument
WO2006064507A2 (en) * 2004-12-17 2006-06-22 Human Monitoring Ltd. Vehicle vision system
CN101599207A (en) * 2009-05-06 2009-12-09 深圳市汉华安道科技有限责任公司 A kind of fatigue driving detection device and automobile
CN102881116A (en) * 2011-07-13 2013-01-16 上海库源电气科技有限公司 System and method for pre-warning of fatigue driving
JP2013118157A (en) * 2011-12-01 2013-06-13 Shuji Hatano Visual environment improving instrument
CN104637299A (en) * 2014-12-30 2015-05-20 东莞市高明企业服务有限公司 Safe driving control system and safe driving control method based on cloud
CN104760538A (en) * 2015-04-29 2015-07-08 深圳市保千里电子有限公司 Fatigue driving preventing massage device and using method thereof
CN107157721A (en) * 2017-05-11 2017-09-15 张新成 Visual training method, device and sight training instrument
CN207356174U (en) * 2017-04-12 2018-05-15 杨老秀 A kind of driving safety goggle
CN108349455A (en) * 2015-10-26 2018-07-31 主动知识有限责任公司 Autonomous road vehicle with the absorption of vibrations energy dissipation pad for being placed in eye level
CN110520824A (en) * 2017-04-14 2019-11-29 奇跃公司 The tracking of multi-mode eyes
CN110840720A (en) * 2019-11-21 2020-02-28 赵成玉 Vision training system and method
CN111583585A (en) * 2020-05-26 2020-08-25 苏州智华汽车电子有限公司 Information fusion fatigue driving early warning method, system, device and medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109431445A (en) * 2018-08-03 2019-03-08 广州视光专业技术服务有限公司 A kind of vision monitoring method, apparatus, terminal device and storage medium
CN111543934A (en) * 2020-04-29 2020-08-18 深圳创维-Rgb电子有限公司 Vision detection method and device, electronic product and storage medium

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2695021Y (en) * 2003-09-16 2005-04-27 梁平 Driver fatigue health-care instrument
WO2006064507A2 (en) * 2004-12-17 2006-06-22 Human Monitoring Ltd. Vehicle vision system
CN101599207A (en) * 2009-05-06 2009-12-09 深圳市汉华安道科技有限责任公司 A kind of fatigue driving detection device and automobile
CN102881116A (en) * 2011-07-13 2013-01-16 上海库源电气科技有限公司 System and method for pre-warning of fatigue driving
JP2013118157A (en) * 2011-12-01 2013-06-13 Shuji Hatano Visual environment improving instrument
CN104637299A (en) * 2014-12-30 2015-05-20 东莞市高明企业服务有限公司 Safe driving control system and safe driving control method based on cloud
CN104760538A (en) * 2015-04-29 2015-07-08 深圳市保千里电子有限公司 Fatigue driving preventing massage device and using method thereof
CN108349455A (en) * 2015-10-26 2018-07-31 主动知识有限责任公司 Autonomous road vehicle with the absorption of vibrations energy dissipation pad for being placed in eye level
CN207356174U (en) * 2017-04-12 2018-05-15 杨老秀 A kind of driving safety goggle
CN110520824A (en) * 2017-04-14 2019-11-29 奇跃公司 The tracking of multi-mode eyes
CN107157721A (en) * 2017-05-11 2017-09-15 张新成 Visual training method, device and sight training instrument
CN110840720A (en) * 2019-11-21 2020-02-28 赵成玉 Vision training system and method
CN111583585A (en) * 2020-05-26 2020-08-25 苏州智华汽车电子有限公司 Information fusion fatigue driving early warning method, system, device and medium

Also Published As

Publication number Publication date
CN112168636A (en) 2021-01-05

Similar Documents

Publication Publication Date Title
JP6933668B2 (en) Driving condition monitoring methods and devices, driver monitoring systems, and vehicles
US20210012128A1 (en) Driver attention monitoring method and apparatus and electronic device
JP7146959B2 (en) DRIVING STATE DETECTION METHOD AND DEVICE, DRIVER MONITORING SYSTEM AND VEHICLE
US10915769B2 (en) Driving management methods and systems, vehicle-mounted intelligent systems, electronic devices, and medium
CN108928294B (en) Driving danger reminding method and device, terminal and computer readable storage medium
CN111079476B (en) Driving state analysis method and device, driver monitoring system and vehicle
Craye et al. Driver distraction detection and recognition using RGB-D sensor
JP2020525334A (en) Operation management method and system, in-vehicle smart system, electronic device and medium
CN110395260B (en) Vehicle, safe driving method and device
CN105956548A (en) Driver fatigue state detection method and device
CN109664891A (en) Auxiliary driving method, device, equipment and storage medium
CN112754498B (en) Driver fatigue detection method, device, equipment and storage medium
CN107862296A (en) The monitoring method and system of driving behavior, computer-readable recording medium
CN109801475A (en) Method for detecting fatigue driving, device and computer readable storage medium
CN111860254A (en) Driver abnormal behavior detection method and device, storage medium and equipment
CN109407845A (en) Screen exchange method and screen interactive device
CN109409259A (en) Drive monitoring method, device, equipment and computer-readable medium
DE102016205996A1 (en) Method for issuing a drowsiness warning and control device
CN112168636B (en) In-vehicle vision improving device, equipment and system
US20180022357A1 (en) Driving recorder system
CN113771859A (en) Intelligent driving intervention method, device and equipment and computer readable storage medium
KR102494530B1 (en) Camera Apparatus Installing at a Car for Detecting Drowsy Driving and Careless Driving and Method thereof
CN113312958B (en) Method and device for adjusting dispatch priority based on driver state
Ujir et al. Real-Time Driver’s Monitoring Mobile Application through Head Pose, Drowsiness and Angry Detection
CN110807899A (en) Driver state comprehensive monitoring method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant