CN111942285A - Intelligent vision-impaired person service method and system based on vehicle-mounted glass vibration feedback - Google Patents
Intelligent vision-impaired person service method and system based on vehicle-mounted glass vibration feedback Download PDFInfo
- Publication number
- CN111942285A CN111942285A CN202010664048.8A CN202010664048A CN111942285A CN 111942285 A CN111942285 A CN 111942285A CN 202010664048 A CN202010664048 A CN 202010664048A CN 111942285 A CN111942285 A CN 111942285A
- Authority
- CN
- China
- Prior art keywords
- information
- vehicle
- vibration feedback
- motor vehicle
- real time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 239000011521 glass Substances 0.000 title claims abstract description 62
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000012544 monitoring process Methods 0.000 claims abstract description 39
- 230000004424 eye movement Effects 0.000 claims abstract description 31
- 238000004088 simulation Methods 0.000 claims abstract description 19
- 238000001514 detection method Methods 0.000 claims abstract description 16
- 208000029257 vision disease Diseases 0.000 claims abstract description 9
- 238000005516 engineering process Methods 0.000 claims abstract description 8
- 206010047571 Visual impairment Diseases 0.000 claims abstract description 6
- 230000004393 visual impairment Effects 0.000 claims abstract description 6
- 230000007246 mechanism Effects 0.000 claims description 55
- 230000001771 impaired effect Effects 0.000 claims description 34
- 238000006243 chemical reaction Methods 0.000 claims description 26
- 238000004458 analytical method Methods 0.000 claims description 17
- 238000012790 confirmation Methods 0.000 claims description 13
- 230000004888 barrier function Effects 0.000 claims description 11
- 230000000007 visual effect Effects 0.000 claims description 11
- 230000009466 transformation Effects 0.000 claims description 8
- 238000004364 calculation method Methods 0.000 claims description 6
- 238000007726 management method Methods 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 3
- 239000000284 extract Substances 0.000 abstract description 5
- 230000006735 deficit Effects 0.000 abstract 1
- 230000006870 function Effects 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 239000004576 sand Substances 0.000 description 2
- 241001465754 Metazoa Species 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000010223 real-time analysis Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60N—SEATS SPECIALLY ADAPTED FOR VEHICLES; VEHICLE PASSENGER ACCOMMODATION NOT OTHERWISE PROVIDED FOR
- B60N2/00—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles
- B60N2/002—Seats provided with an occupancy detection means mounted therein or thereon
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
- B60R21/01—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Ophthalmology & Optometry (AREA)
- Health & Medical Sciences (AREA)
- Aviation & Aerospace Engineering (AREA)
- Transportation (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
- Navigation (AREA)
- Traffic Control Systems (AREA)
Abstract
An intelligent vision impairment personnel service method and system based on vehicle-mounted glass vibration feedback comprise the following steps: if the vehicle-mounted terminal is started by feedback, the temperature sensor is controlled to acquire cushion temperature information and analyze whether the cushion temperature information exceeds a preset temperature in real time, if so, the eye tracker is controlled to acquire human eye movement information of a seat and analyze whether a human body is a person with visual impairment, if so, the monitoring camera is controlled to shoot a monitoring image and extract object information contained in the monitoring image according to an image recognition technology, the object information is converted to generate vibration feedback information and generate sound simulation information corresponding to the object information, the laser transmitter and the laser receiver are controlled to acquire touch detection information and analyze whether the human body touches the vehicle-mounted glass, if so, the vehicle-mounted glass is controlled to enter a real-time touch vibration feedback state through the vibration feedback equipment and the loudspeaker is controlled to play voice information corresponding to the sound simulation information, and after the human body is analyzed to cancel the touch of the vehicle-mounted glass, controlling the vibration feedback equipment and the loudspeaker to stop.
Description
Technical Field
The invention relates to the field of riding assistance of visually impaired people, in particular to an intelligent visually impaired people service method and system based on vehicle-mounted glass vibration feedback.
Background
The blind, as a special group in society, needs the society to give them more care and care, enabling them to live better independently. With the development and complexity of road traffic, the blind people face more road choices when going out.
The blind people can generally fall into two types, one type is a walking mode, the other type is a driving and long-distance mode, and the sight-impaired people cannot see the scenery of the vehicle window during driving.
Therefore, how to combine together on-vehicle glass and visual barrier personnel and vibrating device for when detecting that there is visual barrier personnel to take a bus or a trip, obtain the seat and the on-vehicle glass information that visual barrier personnel correspond and when visual barrier personnel touched on-vehicle glass, carry out the vibration of corresponding grade with the outside real-time scenery of door window through the on-vehicle glass of vibrating device control door window, with the profile of the scenery outside the simulation window and provide visual barrier personnel through the outside scenery of touch perception door window the problem that needs to solve at present urgently.
Disclosure of Invention
The purpose of the invention is as follows: in order to overcome the defects in the background art, the embodiment of the invention provides an intelligent visually impaired person service method and system based on vehicle-mounted glass vibration feedback, which can effectively solve the problems related to the background art.
The technical scheme is as follows:
an intelligent visually impaired person service method based on vehicle-mounted glass vibration feedback comprises the following steps:
s1, if starting information is fed back by the vehicle-mounted terminal which is kept in the connection relation, controlling a temperature sensor arranged in a cushion of a motor vehicle seat to start to acquire cushion temperature information in real time, and analyzing whether the temperature exceeds a preset temperature in real time according to the cushion temperature information;
s2, if yes, controlling an eye movement instrument bound with the seat to start to acquire human eye movement information of the seat in real time and analyzing whether a human body sitting on the seat is a vision-impaired person or not according to the human eye movement information;
s3, if yes, controlling a monitoring camera arranged at the position, corresponding to the outside of the window, of the seat to start a monitoring image outside a real-time shooting area, and extracting object information contained in the monitoring image in real time according to an image recognition technology;
s4, converting in real time according to the real-time extracted object information to generate vibration feedback information and generating sound simulation information corresponding to the object information in real time according to the real-time extracted object information;
s5, controlling the laser transmitters and the laser receivers arranged at the two sides of the car window to start to acquire touch detection information in real time and analyzing whether a person with visual impairment touches the car-mounted glass or not according to the touch detection information;
s6, if yes, controlling the vehicle-mounted glass arranged at the position of the vehicle window to enter a real-time touch vibration feedback state through the bound vibration feedback equipment according to the vibration feedback information, and controlling a loudspeaker bound with the vehicle window to play voice information corresponding to the sound simulation information in real time;
and S7, after the vision disorder person is analyzed through the touch detection information to cancel the touch of the vehicle-mounted glass, controlling the vibration feedback equipment and the loudspeaker to stop running.
As a preferred mode of the present invention, after S1, the method further includes the steps of:
s10, acquiring the driving information fed back by the vehicle-mounted terminal in real time and analyzing whether the motor vehicle has an accident or not in real time according to the driving information;
s11, if the vehicle-mounted terminal is judged to be in the normal state, feeding back glass vibration information to the vehicle-mounted terminal and receiving confirmation information fed back by the vehicle-mounted terminal in real time;
s12, analyzing whether the vehicle-mounted terminal has feedback confirmation information or not in real time or not when the preset time is exceeded;
and S13, if yes, controlling a vibration feedback device arranged at the position of the vehicle window of the motor vehicle to enter a high-frequency vibration state so as to shatter the vehicle-mounted glass of the motor vehicle.
As a preferable mode of the present invention, in S4, the method further includes the steps of:
s40, converting the real-time extracted object information into a high-contrast black-and-white image, and calculating the contour and the depth information of the real-time object information in real time according to the high-contrast black-and-white image;
and S41, converting the contour information and the depth information in real time to generate vibration feedback information of corresponding levels, and transmitting the vibration feedback information generated in real time to vibration feedback equipment for binding the window position of the sitting seat of the visually impaired.
As a preferable mode of the present invention, in S6, the method further includes the steps of:
s60, converting the information in real time according to the object information corresponding to the vibration feedback information to generate Braille information and controlling the starting of a lifting mechanism of a Braille conversion area arranged at the position below the window;
and S61, controlling the lifting column group which is connected with the lifting mechanism of the Braille conversion area in a driving way to combine to form corresponding Braille according to the Braille information generated in real time.
As a preferable mode of the present invention, in S1, the method further includes the steps of:
s100, acquiring pressure information above a navigation platform of the ground position of the motor vehicle where the vehicle-mounted terminal is located in real time, and analyzing whether a human body steps on the navigation platform according to the pressure information;
s102, if yes, controlling a high-definition camera arranged in the motor vehicle to start to capture a high-definition image in real time and analyzing an empty seat area of the motor vehicle in real time according to the high-definition image;
s103, controlling the navigation platform to start to move to a seat area corresponding to the vacant seat area through a driving mechanism at the position of the ground guide rail and controlling the navigation platform to rotate towards the vacant seat through a rotating mechanism.
An intelligent visually impaired person service system based on vehicle-mounted glass vibration feedback uses an intelligent visually impaired person service method based on vehicle-mounted glass vibration feedback, and comprises a motor vehicle device, a visually impaired auxiliary device and a server;
the motor vehicle device comprises temperature sensors, an eye tracker, a monitoring camera, a laser transmitter, a laser receiver and a high-definition camera, wherein the number of the temperature sensors is consistent with that of motor vehicle seats, the temperature sensors are arranged in a cushion of the motor vehicle seats, and the temperature sensors are used for acquiring temperature information of the cushion area; the number of the eye tracker is consistent with that of the motor vehicle seats, and the eye tracker is arranged at the top end position of the motor vehicle seat area and used for acquiring eye movement information of a human body; the number of the monitoring cameras is consistent with that of the windows of the motor vehicle, the monitoring cameras are arranged at the outer positions of the windows of the motor vehicle and are used for acquiring images of the environment outside the windows of the motor vehicle; the laser transmitter is arranged at the side position of the window of the motor vehicle and used for transmitting laser information to the laser receiver; the laser receiver is arranged at the side position of the window of the motor vehicle and used for receiving laser information emitted by the laser emitter; the high-definition camera is arranged at the position inside the motor vehicle and is used for acquiring an image of the environment inside the motor vehicle;
the visual barrier auxiliary device comprises vibration feedback equipment, a loudspeaker, a Braille transformation area, a lifting mechanism, lifting columns, ground guide rails, a navigation platform, a driving mechanism and a rotating mechanism, wherein the number of the vibration feedback equipment is consistent with that of the motor vehicle windows, the vibration feedback equipment is arranged at the periphery of vehicle-mounted glass of the motor vehicle windows and used for displaying the outline and depth of corresponding object information through vibration; the number of the loudspeakers is consistent with that of the windows of the motor vehicle, and the loudspeakers are arranged at the lower position inside the windows of the motor vehicle and used for playing voice information; the number of the Braille conversion areas is consistent with that of the motor vehicle windows, and the Braille conversion areas are arranged at the lower position inside the motor vehicle windows and used for displaying Braille characters; the lifting mechanism is arranged in the Braille transformation area, is connected with the lifting column and is used for driving the connected lifting column to stretch; the lifting columns are arranged in the Braille conversion area and used for combining to form Braille characters after extending out; the ground guide rail is arranged on the ground position of the public large-scale motor vehicle and is used for providing the driving mechanism for moving; the navigation platform is arranged in a vision-impaired service area of the motor vehicle and is provided with a pressure identification sensor for transporting a trampled human body to a corresponding seat; the driving mechanism is connected with the navigation platform and used for driving the navigation platform to move at the ground guide rail position; the rotating mechanism is arranged in the middle of the navigation platform and used for driving the navigation platform to rotate;
the server is arranged at a placement position planned by a motor vehicle management department, and comprises:
the wireless module 30 is used for being respectively connected with a temperature sensor, an eye tracker, a monitoring camera, a laser transmitter, a laser receiver, a high-definition camera, vibration feedback equipment, a loudspeaker, a lifting mechanism, a navigation platform, a driving mechanism, a rotating mechanism, a motor vehicle management department and a network;
the information receiving module is used for receiving information and/or instructions and/or requests;
the temperature identification module is used for controlling the temperature sensor to be started or closed;
the information analysis module is used for processing and analyzing the information according to the specified information;
the eye movement identification module is used for controlling the start or the close of the eye movement instrument;
the monitoring shooting module is used for controlling the starting or closing of the monitoring camera;
the image identification module is used for identifying object information contained in the image according to an image identification technology;
the vibration conversion module is used for converting the object information in real time to generate vibration feedback information of corresponding grades;
the voice simulation module is used for generating corresponding sound simulation information from the object information in real time;
the laser identification module is used for controlling the laser transmitter and the laser receiver to acquire touch detection information in real time;
the vibration feedback module is used for controlling the vibration feedback equipment to execute set tactile vibration feedback operation according to set steps;
and the voice playing module is used for controlling the loudspeaker to execute the set voice playing operation according to the set steps.
As a preferred aspect of the present invention, the server further includes:
the information sending module is used for sending specified information and/or instructions and/or requests to the specified objects;
and the high-frequency vibration module is used for controlling the vibration feedback equipment to execute the set high-frequency vibration operation according to the set steps.
As a preferred aspect of the present invention, the server further includes:
and the contour calculation module is used for calculating the real-time contour and the depth information in real time according to the specified high-contrast black-and-white image.
As a preferred aspect of the present invention, the server further includes:
the Braille conversion module is used for converting the information of the specified object to generate Braille characters;
and the lifting control module is used for controlling the lifting mechanism to execute the set telescopic combined braille character operation of the lifting columns according to the set steps.
As a preferred aspect of the present invention, the server further includes:
the information acquisition module is used for acquiring the specified information and/or instruction and/or request of the specified object;
the high-definition shooting module is used for controlling the high-definition camera to be started or closed;
the track moving module is used for controlling the driving mechanism to execute the set ground guide rail moving operation of the navigation platform according to the set steps;
and the navigation rotating module is used for controlling the rotating mechanism to execute the set navigation platform rotating operation according to the set steps.
The invention realizes the following beneficial effects:
1. after intelligence visual barrier personnel service system starts the completion, human eye movement information that real-time analysis motor vehicle seat sat goes out through eye movement information analysis human for visual barrier personnel back, control the monitoring camera that human sitting seat corresponds starts to ingest the control image in real time and through the outside object information of control image real-time identification, then converts object information into corresponding vibration information and after discernment visual barrier personnel touch vehicle-mounted glass, control vehicle-mounted glass carries out the profile of vibration in order to simulate outside the window scenery and provide visual barrier personnel through the outside scenery of touch perception door window through vibration feedback equipment, simultaneously control speaker voice simulation with the sound information that object information corresponds.
2. When an accident of the motor vehicle is detected, feeding back glass vibration information to the corresponding vehicle-mounted terminal, and controlling the vibration feedback equipment to enter a high-frequency vibration state to shatter the vehicle-mounted glass after the vehicle-mounted terminal feeds back confirmation or no information is fed back after overtime.
3. And when the human body exists in the navigation platform, identifying corresponding seat information and controlling the navigation platform to automatically navigate to the identified seat position.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
FIG. 1 is a flow chart of a method for providing intelligent visually impaired personnel services in accordance with one embodiment of the present invention;
FIG. 2 is a flow chart of an incident handling method provided by one example of the present invention;
FIG. 3 is a flow chart of a vibration level translation method provided by one example of the present invention;
FIG. 4 is a flow chart of a method of Braille conversion provided by one example of the present invention;
FIG. 5 is a flow chart of a method for controlling ground navigation according to an exemplary embodiment of the present invention;
FIG. 6 is a connection diagram of an intelligent visually impaired people service system according to an exemplary embodiment of the present invention;
FIG. 7 is a partial schematic view of a vehicle glazing area provided in accordance with one example of the invention;
FIG. 8 is a schematic cross-sectional view of a Braille transform area provided by one example of the present invention;
FIG. 9 is a schematic illustration of a ground track area of a navigation platform according to an example of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
Example one
Referring to fig. 1, fig. 3-4, fig. 6-8.
Specifically, the embodiment provides an intelligent visually impaired person service method based on vehicle-mounted glass vibration feedback, and the method includes the following steps:
and S1, if starting information is fed back by the vehicle-mounted terminal which is kept in the connection relation, controlling the temperature sensor 10 arranged in the cushion of the motor vehicle seat to start to acquire cushion temperature information in real time and analyzing whether the temperature exceeds the preset temperature in real time according to the cushion temperature information.
In S1, specifically, after the information receiving module 31 included in the server 3 receives the start information fed back by the vehicle-mounted terminal that maintains the connection relationship, the temperature identification module 32 included in the server 3 controls the temperature sensor 10 disposed in the seat cushion of the motor vehicle seat in which the vehicle-mounted terminal is located to start to acquire the temperature information of the seat cushion in real time, and after the temperature sensor 10 is started, the information analysis module 33 included in the server 3 analyzes whether the temperature exceeds a preset temperature in real time according to the temperature information of the seat cushion; the preset temperature is set by the vehicle-mounted terminal, and is preferably 3 ℃ higher than the normal temperature in the vehicle and 3 ℃ lower than the normal temperature in the vehicle in summer and 5 ℃ higher than the normal temperature in the vehicle in winter.
And S2, if yes, controlling the eye movement instrument 11 bound with the seat to start to acquire the human eye movement information of the seat in real time and analyzing whether the human body on which the seat is sitting is a person with visual impairment according to the human eye movement information.
In S2, specifically, after the information analysis module 33 analyzes that the temperature of the seat cushion exceeds a preset temperature, the eye movement recognition module 34 included in the server 3 controls the eye movement instrument 11 bound to the seat to start to acquire the human eye movement information of the seat in real time, and after the eye movement instrument 11 starts, the information analysis module 33 analyzes whether the human body on which the seat is sitting is a person with impaired vision according to the human eye movement information; namely, whether the human eye movement is out of focus or not and whether the eye movement track of the human body cannot be identified through the user eye movement information or not are analyzed.
And S3, if yes, controlling the monitoring camera 12 arranged at the position outside the window corresponding to the seat to start the monitoring image outside the real-time shooting area and extracting the object information contained in the monitoring image in real time according to the image recognition technology.
In S3, specifically, after the information analysis module 33 analyzes that the human body on which the seat is sitting is a person with impaired vision, the monitoring camera 12 disposed at a position outside the window corresponding to the seat is controlled by the monitoring camera 35 included in the server 3 to start a monitoring image outside the real-time shooting area, where the monitoring image refers to an environment image outside the window corresponding to the seat and shot by the monitoring camera 12, and meanwhile, the image recognition module 36 included in the server 3 extracts object information included in the monitoring image in real time according to an image recognition technology, that is, extracts real-time object information included in the real-time monitoring image.
And S4, converting in real time according to the real-time extracted object information to generate vibration feedback information, and generating sound simulation information corresponding to the object information in real time according to the real-time extracted object information.
In S4, specifically, after the image recognition module 36 extracts the object information in real time, the vibration conversion module 37 included in the server 3 converts the object information extracted in real time by the image recognition module 36 in real time to generate vibration feedback information, and the voice simulation module 38 included in the server 3 generates the sound simulation information corresponding to the object information in real time according to the object information extracted in real time by the image recognition module 36; for example, the sound of sand and sand generated by trees, bird sound generated by flying birds, running water generated by rivers, and cry generated by animals can be simulated.
And S5, controlling the laser transmitters 13 and the laser receivers 14 arranged at the two sides of the car window to start to acquire touch detection information in real time and analyzing whether a person with vision disorder touches the car-mounted glass according to the touch detection information.
In S5, specifically, after the seat is seated with a human body, the laser recognition module 39 included in the server 3 controls the laser transmitters 13 and the laser receivers 14 disposed at the two sides of the window to start to acquire touch detection information in real time, so that a sensing network is formed by the laser transmitters 13 and the laser receivers 14, and when a human body touches the vehicle-mounted glass, the touch position of the human body is automatically acquired; after the laser transmitter 13 and the laser receiver 14 are started, the information analysis module 33 analyzes whether a person with visual impairment touches the vehicle-mounted glass according to the touch detection information.
And S6, if yes, controlling the vehicle-mounted glass arranged at the vehicle window position to enter a real-time touch vibration feedback state through the bound vibration feedback equipment 20 according to the vibration feedback information, and controlling the loudspeaker 21 bound with the vehicle window to play the voice information corresponding to the sound simulation information in real time.
In S6, specifically, after the information analysis module 33 analyzes that the visually impaired person touches the vehicle-mounted glass, the vibration feedback module 40 included in the server 3 controls the vehicle-mounted glass arranged at the window position to enter a real-time tactile vibration feedback state through the bound vibration feedback device 20 according to the vibration feedback information, so as to simulate the contour information of the real-time object information, and the voice playing module 41 included in the server 3 controls the speaker 21 bound to the window to play the voice information corresponding to the sound simulation information in real time; thereby allowing the visually impaired to perceive the external scenery.
And S7, controlling the vibration feedback device 20 and the loudspeaker 21 to stop running after the vision-impaired person is analyzed to cancel the touch of the vehicle-mounted glass through the touch detection information.
In S7, specifically, after the information analysis module 33 analyzes that the visually impaired person cancels the touch of the vehicle-mounted glass through the touch detection information, the vibration feedback module 40 controls the vibration feedback device 20 to stop operating, and the voice playing module 41 controls the speaker 21 to stop operating.
As a preferable mode of the present invention, in S4, the method further includes the steps of:
and S40, converting the real-time extracted object information to generate a high-contrast black-and-white image, and calculating the contour and the depth information of the real-time object information in real time according to the high-contrast black-and-white image.
Specifically, after the image recognition module 36 extracts the object information in real time, the vibration conversion module 37 converts the object information extracted by the image recognition module 36 in real time to generate a high-contrast black-and-white image, and the contour calculation module 44 included in the server 3 calculates the contour and the depth information of the real-time object information in real time according to the high-contrast black-and-white image.
And S41, converting in real time according to the contour information and the depth information to generate vibration feedback information of corresponding levels, and transmitting the vibration feedback information generated in real time to the vibration feedback equipment 20 for binding the window position of the sitting seat of the visually impaired.
Specifically, after the calculation of the contour calculation module 44, the vibration conversion module 37 converts the contour information and the depth information in real time to generate vibration feedback information of a corresponding level, and then the vibration feedback module 40 transmits the vibration feedback information generated in real time to the vibration feedback device 20 at the position where the window is bound on the sitting seat of the visually impaired person.
As a preferable mode of the present invention, in S6, the method further includes the steps of:
and S60, converting the object information corresponding to the vibration feedback information in real time to generate Braille information and controlling the lifting mechanism 23 arranged in the Braille conversion area 22 at the lower position of the window to start.
Specifically, when the vibration feedback device 20 enters a real-time tactile vibration feedback state and the speaker 21 plays corresponding voice information, the braille conversion module 45 included in the server 3 converts in real time to generate braille text information according to object information corresponding to the vibration feedback information, for example, when the object information is a tree, braille corresponding to the tree is generated; meanwhile, the lifting control module 46 contained in the server 3 controls the lifting mechanism 23 arranged in the Braille transformation area 22 at the position below the window to start.
And S61, controlling the lifting mechanism 23 in the Braille conversion area 22 according to the Braille information generated in real time, and combining the groups of the lifting columns 24 which are connected in a driving way to form the corresponding Braille characters.
Specifically, when the braille converting module 45 converts and generates the braille, the lifting control module 46 controls the lifting mechanism 23 in the braille transformation area 22 to drive and connect the lifting columns 24 according to the braille character information generated in real time to form the corresponding braille characters.
Example two
Referring to fig. 2, fig. 6-7.
This embodiment is substantially identical to the first embodiment, except that, in this embodiment, after S1, the method further includes the following steps:
and S10, acquiring the driving information fed back by the vehicle-mounted terminal in real time and analyzing whether the motor vehicle has an accident or not in real time according to the driving information.
Specifically, after the information receiving module 31 receives the start information fed back by the vehicle-mounted terminal, the information obtaining module 47 included in the server 3 obtains the driving information fed back by the vehicle-mounted terminal in real time, and the information analyzing module 33 analyzes whether an accident occurs in the motor vehicle in real time according to the driving information.
And S11, if the glass vibration information is provided, feeding back the glass vibration information to the vehicle-mounted terminal and receiving confirmation information fed back by the vehicle-mounted terminal in real time.
Specifically, after the information analysis module 33 analyzes that the motor vehicle has an accident, the information sending module 42 included in the server 3 feeds back glass vibration information to the vehicle-mounted terminal to inquire whether a driver of the motor vehicle needs to vibrate and break the vehicle-mounted glass, and meanwhile, the information receiving module 31 receives confirmation information fed back by the vehicle-mounted terminal in real time.
And S12, analyzing whether the vehicle-mounted terminal has feedback confirmation information or does not have feedback confirmation information after the preset time.
Specifically, after the information sending module 42 sends the information of finishing the glass vibration, the information analyzing module 33 analyzes whether the vehicle-mounted terminal has feedback confirmation information or does not have feedback confirmation information after the preset time is exceeded; wherein the preset time is set by the vehicle-mounted terminal, preferably 4 minutes in the embodiment.
And S13, if yes, controlling the vibration feedback device 20 arranged at the position of the vehicle window to enter a high-frequency vibration state so as to shatter the vehicle-mounted glass of the vehicle.
Specifically, after the information analysis module 33 analyzes that the vehicle-mounted terminal has feedback confirmation information or does not have feedback confirmation information after exceeding the preset time, the high-frequency vibration module 43 included in the server 3 controls the vibration feedback device 20 arranged at the vehicle window position to enter a high-frequency vibration state so as to shatter the vehicle-mounted glass of the motor vehicle.
EXAMPLE III
Referring to fig. 5-6, fig. 9.
Specifically, this embodiment is substantially the same as the first embodiment, except that in S1, the method further includes the following steps:
s100, acquiring pressure information above a navigation platform 26 of the ground position of the motor vehicle where the vehicle-mounted terminal is located in real time, and analyzing whether a human body steps on according to the pressure information.
Specifically, after the information receiving module 31 receives the start information fed back by the vehicle-mounted terminal, the information obtaining module 47 obtains the pressure information above the navigation platform 26 at the ground position of the motor vehicle where the vehicle-mounted terminal is located in real time, and meanwhile, the information analyzing module 33 analyzes whether a human body steps on the vehicle-mounted terminal in real time according to the pressure information; i.e. whether a person steps on the navigation platform 26 to request navigation services.
And S102, if so, controlling a high-definition camera 15 arranged in the motor vehicle to start to shoot a high-definition image in real time and analyzing the vacant seat area of the motor vehicle in real time according to the high-definition image.
Specifically, after the information analysis module 33 analyzes that a human body treads on the navigation platform 26, the high-definition shooting module 48 included in the server 3 controls the high-definition camera 15 arranged in the motor vehicle to start to shoot a high-definition image in real time, wherein the high-definition image is an environment image inside the motor vehicle shot by the high-definition camera 15, and meanwhile, the information analysis module 33 analyzes an empty seat area of the motor vehicle in real time according to the high-definition image, or seat information corresponding to a human ticket of the treading on the navigation platform 26.
And S103, controlling the navigation platform 26 to start to move to a seat area corresponding to the vacant seat area through the driving mechanism 27 at the position of the ground guide rail 25, and controlling the navigation platform 26 to rotate to the vacant seat through the rotating mechanism 28.
Specifically, after the information analysis module 33 completes analysis of the seat information, the track movement module 49 included in the server 3 controls the navigation platform 26 to start moving to the seat area corresponding to the analyzed seat information at the position of the ground rail 25 through the driving mechanism 27, and after the navigation platform 26 completes movement, the navigation rotation module 50 included in the server 3 controls the navigation platform 26 to rotate towards the analyzed seat direction through the rotation mechanism 28.
Example four
As shown with reference to fig. 6-9.
Specifically, the embodiment provides an intelligent visually impaired person service system based on vehicle-mounted glass vibration feedback, and an intelligent visually impaired person service method based on vehicle-mounted glass vibration feedback is used, and comprises a motor vehicle device 1, a visually impaired auxiliary device 2 and a server 3;
the motor vehicle device 1 comprises temperature sensors 10, an eye tracker 11, a monitoring camera 12, a laser emitter 13, a laser receiver 14 and a high-definition camera 15, wherein the number of the temperature sensors 10 is consistent with that of motor vehicle seats, and the temperature sensors are arranged in cushion areas of the motor vehicle seats and used for acquiring temperature information of the cushion areas; the number of the eye movement instruments 11 is consistent with that of the motor vehicle seats, and the eye movement instruments are arranged at the top end position of the motor vehicle seat area and used for acquiring eye movement information of a human body; the number of the monitoring cameras 12 is consistent with that of the windows of the motor vehicle, and the monitoring cameras are arranged at the outer positions of the windows of the motor vehicle and used for acquiring images of the environment outside the windows of the motor vehicle; the laser transmitter 13 is arranged at the side position of the window of the motor vehicle and used for transmitting laser information to the laser receiver 14; the laser receiver 14 is arranged at the side position of the window of the motor vehicle and is used for receiving laser information emitted by the laser emitter 13; the high-definition camera 15 is arranged at an internal position of the motor vehicle and is used for acquiring an internal environment image of the motor vehicle;
the visual impairment assisting device 2 comprises vibration feedback devices 20, a loudspeaker 21, a Braille transformation area 22, a lifting mechanism 23, a lifting column 24, a ground guide rail 25, a navigation platform 26, a driving mechanism 27 and a rotating mechanism 28, wherein the number of the vibration feedback devices 20 is consistent with that of the vehicle windows of the motor vehicle, the vibration feedback devices are arranged at the periphery of vehicle-mounted glass of the vehicle windows and used for displaying the outline and depth of corresponding object information through vibration; the number of the loudspeakers 21 is consistent with that of the windows of the motor vehicle, and the loudspeakers are arranged at the lower position inside the windows of the motor vehicle and used for playing voice information; the number of the Braille conversion areas 22 is consistent with that of the motor vehicle windows, and the Braille conversion areas are arranged at the lower position inside the motor vehicle windows and used for displaying Braille characters; the lifting mechanism 23 is arranged in the braille transformation area 22, is connected with the lifting column 24 and is used for driving the connected lifting column 24 to stretch and retract; the lifting column 24 is arranged in the Braille conversion area 22 and is used for combining to form Braille characters after extending out; the ground guide rail 25 is arranged on the ground position of the public large-scale motor vehicle and is used for providing the movement of the driving mechanism 27; the navigation platform 26 is arranged in the vision-impaired service area of the motor vehicle and is provided with a pressure identification sensor for transporting the trampled human body to a corresponding seat; the driving mechanism 27 is connected with the navigation platform 26 and is used for driving the navigation platform 26 to move at the position of the ground guide rail 25; the rotating mechanism 28 is arranged in the middle of the navigation platform 26 and is used for driving the navigation platform 26 to rotate;
the server 3 is arranged at a placement position planned by a motor vehicle management department, and the server 3 comprises:
the wireless module is used for being respectively connected with the temperature sensor 10, the eye tracker 11, the monitoring camera 12, the laser emitter 13, the laser receiver 14, the high-definition camera 15, the vibration feedback equipment 20, the loudspeaker 21, the lifting mechanism 23, the navigation platform 26, the driving mechanism 27, the rotating mechanism 28, the motor vehicle management department and a network;
an information receiving module 31, configured to receive information and/or instructions and/or requests;
the temperature identification module 32 is used for controlling the temperature sensor 10 to be started or closed;
an information analysis module 33 for processing and analyzing information according to the specified information;
the eye movement identification module 34 is used for controlling the eye movement instrument 11 to be started or closed;
the monitoring shooting module 35 is used for controlling the monitoring camera 12 to start or close;
an image recognition module 36, configured to recognize object information included in the image according to an image recognition technology;
the vibration conversion module 37 is used for converting the object information in real time to generate vibration feedback information of corresponding levels;
the voice simulation module 38 is used for generating corresponding sound simulation information from the object information in real time;
the laser identification module 39 is used for controlling the laser transmitter 13 and the laser receiver 14 to acquire touch detection information in real time;
a vibration feedback module 40 for controlling the vibration feedback device 20 to perform a set haptic vibration feedback operation according to the set steps;
and a voice playing module 41, configured to control the speaker 21 to perform a set voice playing operation according to the set steps.
As a preferred aspect of the present invention, the server 3 further includes:
an information sending module 42, configured to send specified information and/or instructions and/or requests to specified objects;
and a dithering module 43 for controlling the vibration feedback device 20 to perform the set dithering operation according to the set steps.
As a preferred aspect of the present invention, the server 3 further includes:
and the contour calculation module 44 is used for calculating the real-time contour and the depth information in real time according to the specified high-contrast black-and-white image.
As a preferred aspect of the present invention, the server 3 further includes:
the braille conversion module 45 is used for converting the information of the specified object to generate braille characters;
and the lifting control module 46 is used for controlling the lifting mechanism 23 to execute the set telescopic combined braille character operation of the lifting column 24 according to the set steps.
As a preferred aspect of the present invention, the server 3 further includes:
an information obtaining module 47, configured to obtain specified information and/or instructions and/or requests of specified objects;
the high-definition shooting module 48 is used for controlling the high-definition camera 15 to be started or closed;
a track moving module 49 for controlling the driving mechanism 27 to execute the set moving operation of the ground guide 25 of the navigation platform 26 according to the set steps;
and a navigation rotating module 50 for controlling the rotating mechanism 28 to execute the set rotation operation of the navigation platform 26 according to the set steps.
The vehicle-mounted glass adopts an LED screen, images shot by the monitoring camera 12 are converted into gray images, and then the gray images are converted into a plurality of different vibration levels through the light and dark colors.
It should be understood that, in the fourth embodiment, the specific implementation process of each module described above may correspond to the description of the above method embodiments (the first to the third embodiments), and is not described in detail here.
The system provided in the fourth embodiment is only illustrated by dividing the functional modules, and in practical applications, the above-mentioned functions may be distributed by different functional modules according to needs, that is, the internal structure of the system is divided into different functional modules to complete all or part of the functions described above.
The above embodiments are merely illustrative of the technical ideas and features of the present invention, and are intended to enable those skilled in the art to understand the contents of the present invention and implement the present invention, and not to limit the scope of the present invention. All equivalent changes or modifications made according to the spirit of the present invention should be covered within the protection scope of the present invention.
Claims (10)
1. An intelligent visually impaired person service method based on vehicle-mounted glass vibration feedback is characterized by comprising the following steps:
s1, if starting information is fed back by the vehicle-mounted terminal which is kept in the connection relation, controlling a temperature sensor arranged in a cushion of a motor vehicle seat to start to acquire cushion temperature information in real time, and analyzing whether the temperature exceeds a preset temperature in real time according to the cushion temperature information;
s2, if yes, controlling an eye movement instrument bound with the seat to start to acquire human eye movement information of the seat in real time and analyzing whether a human body sitting on the seat is a vision-impaired person or not according to the human eye movement information;
s3, if yes, controlling a monitoring camera arranged at the position, corresponding to the outside of the window, of the seat to start a monitoring image outside a real-time shooting area, and extracting object information contained in the monitoring image in real time according to an image recognition technology;
s4, converting in real time according to the real-time extracted object information to generate vibration feedback information and generating sound simulation information corresponding to the object information in real time according to the real-time extracted object information;
s5, controlling the laser transmitters and the laser receivers arranged at the two sides of the car window to start to acquire touch detection information in real time and analyzing whether a person with visual impairment touches the car-mounted glass or not according to the touch detection information;
s6, if yes, controlling the vehicle-mounted glass arranged at the position of the vehicle window to enter a real-time touch vibration feedback state through the bound vibration feedback equipment according to the vibration feedback information, and controlling a loudspeaker bound with the vehicle window to play voice information corresponding to the sound simulation information in real time;
and S7, after the vision disorder person is analyzed through the touch detection information to cancel the touch of the vehicle-mounted glass, controlling the vibration feedback equipment and the loudspeaker to stop running.
2. The intelligent visually impaired people service method based on-board glass vibration feedback according to claim 1, wherein after S1, the method further comprises the following steps:
s10, acquiring the driving information fed back by the vehicle-mounted terminal in real time and analyzing whether the motor vehicle has an accident or not in real time according to the driving information;
s11, if the vehicle-mounted terminal is judged to be in the normal state, feeding back glass vibration information to the vehicle-mounted terminal and receiving confirmation information fed back by the vehicle-mounted terminal in real time;
s12, analyzing whether the vehicle-mounted terminal has feedback confirmation information or not in real time or not when the preset time is exceeded;
and S13, if yes, controlling a vibration feedback device arranged at the position of the vehicle window of the motor vehicle to enter a high-frequency vibration state so as to shatter the vehicle-mounted glass of the motor vehicle.
3. The method for intelligently serving visually impaired people based on vehicle-mounted glass vibration feedback according to claim 1, wherein in S4, the method further comprises the following steps:
s40, converting the real-time extracted object information into a high-contrast black-and-white image, and calculating the contour and the depth information of the real-time object information in real time according to the high-contrast black-and-white image;
and S41, converting the contour information and the depth information in real time to generate vibration feedback information of corresponding levels, and transmitting the vibration feedback information generated in real time to vibration feedback equipment for binding the window position of the sitting seat of the visually impaired.
4. The method for intelligently serving visually impaired people based on vehicle-mounted glass vibration feedback according to claim 1, wherein in S6, the method further comprises the following steps:
s60, converting the information in real time according to the object information corresponding to the vibration feedback information to generate Braille information and controlling the starting of a lifting mechanism of a Braille conversion area arranged at the position below the window;
and S61, controlling the lifting column group which is connected with the lifting mechanism of the Braille conversion area in a driving way to combine to form corresponding Braille according to the Braille information generated in real time.
5. The method for intelligently serving visually impaired people based on vehicle-mounted glass vibration feedback according to claim 1, wherein in S1, the method further comprises the following steps:
s100, acquiring pressure information above a navigation platform of the ground position of the motor vehicle where the vehicle-mounted terminal is located in real time, and analyzing whether a human body steps on the navigation platform according to the pressure information;
s102, if yes, controlling a high-definition camera arranged in the motor vehicle to start to capture a high-definition image in real time and analyzing an empty seat area of the motor vehicle in real time according to the high-definition image;
s103, controlling the navigation platform to start to move to a seat area corresponding to the vacant seat area through a driving mechanism at the position of the ground guide rail and controlling the navigation platform to rotate towards the vacant seat through a rotating mechanism.
6. An intelligent visually impaired person service system based on vehicle-mounted glass vibration feedback, which uses the intelligent visually impaired person service method based on vehicle-mounted glass vibration feedback of any one of claims 1 to 5, and comprises a motor vehicle device, a visually impaired auxiliary device and a server, and is characterized in that:
the motor vehicle device comprises temperature sensors, an eye tracker, a monitoring camera, a laser transmitter, a laser receiver and a high-definition camera, wherein the number of the temperature sensors is consistent with that of motor vehicle seats, the temperature sensors are arranged in a cushion of the motor vehicle seats, and the temperature sensors are used for acquiring temperature information of the cushion area; the number of the eye tracker is consistent with that of the motor vehicle seats, and the eye tracker is arranged at the top end position of the motor vehicle seat area and used for acquiring eye movement information of a human body; the number of the monitoring cameras is consistent with that of the windows of the motor vehicle, the monitoring cameras are arranged at the outer positions of the windows of the motor vehicle and are used for acquiring images of the environment outside the windows of the motor vehicle; the laser transmitter is arranged at the side position of the window of the motor vehicle and used for transmitting laser information to the laser receiver; the laser receiver is arranged at the side position of the window of the motor vehicle and used for receiving laser information emitted by the laser emitter; the high-definition camera is arranged at the position inside the motor vehicle and is used for acquiring an image of the environment inside the motor vehicle;
the visual barrier auxiliary device comprises vibration feedback equipment, a loudspeaker, a Braille transformation area, a lifting mechanism, lifting columns, ground guide rails, a navigation platform, a driving mechanism and a rotating mechanism, wherein the number of the vibration feedback equipment is consistent with that of the motor vehicle windows, the vibration feedback equipment is arranged at the periphery of vehicle-mounted glass of the motor vehicle windows and used for displaying the outline and depth of corresponding object information through vibration; the number of the loudspeakers is consistent with that of the windows of the motor vehicle, and the loudspeakers are arranged at the lower position inside the windows of the motor vehicle and used for playing voice information; the number of the Braille conversion areas is consistent with that of the motor vehicle windows, and the Braille conversion areas are arranged at the lower position inside the motor vehicle windows and used for displaying Braille characters; the lifting mechanism is arranged in the Braille transformation area, is connected with the lifting column and is used for driving the connected lifting column to stretch; the lifting columns are arranged in the Braille conversion area and used for combining to form Braille characters after extending out; the ground guide rail is arranged on the ground position of the public large-scale motor vehicle and is used for providing the driving mechanism for moving; the navigation platform is arranged in a vision-impaired service area of the motor vehicle and is provided with a pressure identification sensor for transporting a trampled human body to a corresponding seat; the driving mechanism is connected with the navigation platform and used for driving the navigation platform to move at the ground guide rail position; the rotating mechanism is arranged in the middle of the navigation platform and used for driving the navigation platform to rotate;
the server is arranged at a placement position planned by a motor vehicle management department, and comprises:
the wireless module 30 is used for being respectively connected with a temperature sensor, an eye tracker, a monitoring camera, a laser transmitter, a laser receiver, a high-definition camera, vibration feedback equipment, a loudspeaker, a lifting mechanism, a navigation platform, a driving mechanism, a rotating mechanism, a motor vehicle management department and a network;
the information receiving module is used for receiving information and/or instructions and/or requests;
the temperature identification module is used for controlling the temperature sensor to be started or closed;
the information analysis module is used for processing and analyzing the information according to the specified information;
the eye movement identification module is used for controlling the start or the close of the eye movement instrument;
the monitoring shooting module is used for controlling the starting or closing of the monitoring camera;
the image identification module is used for identifying object information contained in the image according to an image identification technology;
the vibration conversion module is used for converting the object information in real time to generate vibration feedback information of corresponding grades;
the voice simulation module is used for generating corresponding sound simulation information from the object information in real time;
the laser identification module is used for controlling the laser transmitter and the laser receiver to acquire touch detection information in real time;
the vibration feedback module is used for controlling the vibration feedback equipment to execute set tactile vibration feedback operation according to set steps;
and the voice playing module is used for controlling the loudspeaker to execute the set voice playing operation according to the set steps.
7. The vehicle-mounted glass vibration feedback-based intelligent visually impaired people service system according to claim 6, wherein the server further comprises:
the information sending module is used for sending specified information and/or instructions and/or requests to the specified objects;
and the high-frequency vibration module is used for controlling the vibration feedback equipment to execute the set high-frequency vibration operation according to the set steps.
8. The vehicle-mounted glass vibration feedback-based intelligent visually impaired people service system according to claim 6, wherein the server further comprises:
and the contour calculation module is used for calculating the real-time contour and the depth information in real time according to the specified high-contrast black-and-white image.
9. The vehicle-mounted glass vibration feedback-based intelligent visually impaired people service system according to claim 6, wherein the server further comprises:
the Braille conversion module is used for converting the information of the specified object to generate Braille characters;
and the lifting control module is used for controlling the lifting mechanism to execute the set telescopic combined braille character operation of the lifting columns according to the set steps.
10. The vehicle-mounted glass vibration feedback-based intelligent visually impaired people service system according to claim 6, wherein the server further comprises:
the information acquisition module is used for acquiring the specified information and/or instruction and/or request of the specified object;
the high-definition shooting module is used for controlling the high-definition camera to be started or closed;
the track moving module is used for controlling the driving mechanism to execute the set ground guide rail moving operation of the navigation platform according to the set steps;
and the navigation rotating module is used for controlling the rotating mechanism to execute the set navigation platform rotating operation according to the set steps.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010664048.8A CN111942285B (en) | 2020-07-10 | 2020-07-10 | Intelligent vision-impaired person service method and system based on vehicle-mounted glass vibration feedback |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010664048.8A CN111942285B (en) | 2020-07-10 | 2020-07-10 | Intelligent vision-impaired person service method and system based on vehicle-mounted glass vibration feedback |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111942285A true CN111942285A (en) | 2020-11-17 |
| CN111942285B CN111942285B (en) | 2022-11-18 |
Family
ID=73340468
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010664048.8A Active CN111942285B (en) | 2020-07-10 | 2020-07-10 | Intelligent vision-impaired person service method and system based on vehicle-mounted glass vibration feedback |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111942285B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112422829A (en) * | 2020-11-19 | 2021-02-26 | 北京字节跳动网络技术有限公司 | Method, device, terminal and storage medium for assisting in shooting image |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060024647A1 (en) * | 2004-07-30 | 2006-02-02 | France Telecom | Method and apparatus for communicating graphical information to a visually impaired person using haptic feedback |
| CN201501368U (en) * | 2009-07-06 | 2010-06-09 | 郭农斐 | Blasting type vehicle window glass safety automatic-breaking device |
| CN102331838A (en) * | 2011-11-18 | 2012-01-25 | 东南大学 | Method for expressing vibration tactility of image based on depth contour |
| CN102973395A (en) * | 2012-11-30 | 2013-03-20 | 中国舰船研究设计中心 | Multifunctional intelligent blind guiding method, processor and multifunctional intelligent blind guiding device |
| US20130335543A1 (en) * | 2012-06-13 | 2013-12-19 | Esight Corp. | Apparatus and Method for Enhancing Human Visual Performance in a Head Worn Video System |
| CN204124099U (en) * | 2014-09-28 | 2015-01-28 | 广东省工业贸易职业技术学校 | HF oscillation knocks glass for vehicle window escape apparatus |
| CN107015640A (en) * | 2017-02-23 | 2017-08-04 | 珠海市魅族科技有限公司 | The method and device of terminal control vibration |
| CN108844545A (en) * | 2018-06-29 | 2018-11-20 | 合肥信亚达智能科技有限公司 | A kind of auxiliary traveling method and system based on image recognition |
| CN109229047A (en) * | 2018-09-29 | 2019-01-18 | 宁波丞展汽车零部件有限公司 | A kind of automobile safety system |
| KR20190069919A (en) * | 2017-12-12 | 2019-06-20 | (주)리터너블 | Walking assistive device and system for visually impaired people |
| CN110208946A (en) * | 2019-05-31 | 2019-09-06 | 京东方科技集团股份有限公司 | A kind of wearable device and the exchange method based on wearable device |
| CN111035542A (en) * | 2019-12-24 | 2020-04-21 | 开放智能机器（上海）有限公司 | Intelligent blind guiding system based on image recognition |
| CN111329736A (en) * | 2020-02-25 | 2020-06-26 | 何兴 | System for sensing environmental image by means of vibration feedback |
-
2020
- 2020-07-10 CN CN202010664048.8A patent/CN111942285B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060024647A1 (en) * | 2004-07-30 | 2006-02-02 | France Telecom | Method and apparatus for communicating graphical information to a visually impaired person using haptic feedback |
| CN201501368U (en) * | 2009-07-06 | 2010-06-09 | 郭农斐 | Blasting type vehicle window glass safety automatic-breaking device |
| CN102331838A (en) * | 2011-11-18 | 2012-01-25 | 东南大学 | Method for expressing vibration tactility of image based on depth contour |
| US20130335543A1 (en) * | 2012-06-13 | 2013-12-19 | Esight Corp. | Apparatus and Method for Enhancing Human Visual Performance in a Head Worn Video System |
| CN102973395A (en) * | 2012-11-30 | 2013-03-20 | 中国舰船研究设计中心 | Multifunctional intelligent blind guiding method, processor and multifunctional intelligent blind guiding device |
| CN204124099U (en) * | 2014-09-28 | 2015-01-28 | 广东省工业贸易职业技术学校 | HF oscillation knocks glass for vehicle window escape apparatus |
| CN107015640A (en) * | 2017-02-23 | 2017-08-04 | 珠海市魅族科技有限公司 | The method and device of terminal control vibration |
| KR20190069919A (en) * | 2017-12-12 | 2019-06-20 | (주)리터너블 | Walking assistive device and system for visually impaired people |
| CN108844545A (en) * | 2018-06-29 | 2018-11-20 | 合肥信亚达智能科技有限公司 | A kind of auxiliary traveling method and system based on image recognition |
| CN109229047A (en) * | 2018-09-29 | 2019-01-18 | 宁波丞展汽车零部件有限公司 | A kind of automobile safety system |
| CN110208946A (en) * | 2019-05-31 | 2019-09-06 | 京东方科技集团股份有限公司 | A kind of wearable device and the exchange method based on wearable device |
| CN111035542A (en) * | 2019-12-24 | 2020-04-21 | 开放智能机器（上海）有限公司 | Intelligent blind guiding system based on image recognition |
| CN111329736A (en) * | 2020-02-25 | 2020-06-26 | 何兴 | System for sensing environmental image by means of vibration feedback |
Non-Patent Citations (1)
| Title |
|---|
| 太平洋电脑网: "《"https://www.sohu.com/a/230108246_223764"》", 2 May 2018 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112422829A (en) * | 2020-11-19 | 2021-02-26 | 北京字节跳动网络技术有限公司 | Method, device, terminal and storage medium for assisting in shooting image |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111942285B (en) | 2022-11-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111386701B (en) | Image processing apparatus, image processing method, and program | |
| CN106548679B (en) | A kind of intelligent driving training system | |
| CN109636924B (en) | Vehicle-mounted multi-mode augmented reality system based on real road condition information three-dimensional modeling | |
| CN103126862B (en) | Outdoor blind guiding robot based on global position system (GPS), general packet radio service (GPRS) and radio frequency identification devices (RFID) and navigational positioning method | |
| JP2018190217A (en) | Driver monitoring device and driver monitoring method | |
| CN105342769A (en) | Intelligent electric wheelchair | |
| CN109223346B (en) | Voice-controlled navigation wheelchair for blind people and control method thereof | |
| CN112180921A (en) | Automatic driving algorithm training system and method | |
| CN107049719A (en) | A kind of intelligent blind-guiding alarming method for power and its system based on unmanned plane | |
| WO2021187039A1 (en) | Information processing device, information processing method, and computer program | |
| CN111942285B (en) | Intelligent vision-impaired person service method and system based on vehicle-mounted glass vibration feedback | |
| CN106652505A (en) | Street-crossing guiding system for vision disorder pedestrians based on intelligent glasses | |
| KR20210142604A (en) | Information processing methods, programs and information processing devices | |
| CN111035543A (en) | Intelligent blind guiding robot | |
| CN108162755A (en) | A kind of fatigue driving identification control method applied in intelligent vehicle | |
| JP6086515B1 (en) | Driving skill evaluation device, server device, driving skill evaluation system, program, and driving skill evaluation method | |
| CN108609012B (en) | Vehicle lane changing method and vehicle-mounted central control system thereof | |
| CN108806366B (en) | Intelligent automobile driving teaching method and system based on big data analysis | |
| CN106447828A (en) | Automobile data recorder with iris recognition function | |
| CN116129641B (en) | Vehicle security situation calculation method and system based on multi-terminal collaborative identification | |
| CN112384183A (en) | Intelligent blind sidewalk system, blind person walking assisting device and method based on intelligent blind sidewalk system | |
| CN107958573A (en) | A kind of traffic control method being applied in intelligent vehicle | |
| CN112351154B (en) | Unmanned vehicle road condition identification system | |
| DE102022102183A1 (en) | ACCESSIBILITY SYSTEM TO ASSIST A USER INTERACTING WITH A VEHICLE | |
| CN108128241A (en) | A kind of fatigue driving control system for identifying applied in intelligent vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20231201 Address after: 100102 H01, 3 / F, building 6, courtyard 6, Wangjing East Road, Chaoyang District, Beijing Patentee after: Beijing Bailong Mayun Technology Co.,Ltd. Address before: 215400 No.46, Huiyang second village, Loudong street, Taicang City, Suzhou City, Jiangsu Province Patentee before: Xia Muyao |
|
| TR01 | Transfer of patent right |