WO2018119588A1 - Method and system for realizing safe trip of blind person, and wearable device - Google Patents

Method and system for realizing safe trip of blind person, and wearable device Download PDF

Info

Publication number
WO2018119588A1
WO2018119588A1 PCT/CN2016/112135 CN2016112135W WO2018119588A1 WO 2018119588 A1 WO2018119588 A1 WO 2018119588A1 CN 2016112135 W CN2016112135 W CN 2016112135W WO 2018119588 A1 WO2018119588 A1 WO 2018119588A1
Authority
WO
WIPO (PCT)
Prior art keywords
travel
blind
module
image
information
Prior art date
Application number
PCT/CN2016/112135
Other languages
French (fr)
Chinese (zh)
Inventor
王斌
郭松
Original Assignee
深圳前海达闼云端智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳前海达闼云端智能科技有限公司 filed Critical 深圳前海达闼云端智能科技有限公司
Priority to CN201680003358.7A priority Critical patent/CN107072867A/en
Priority to PCT/CN2016/112135 priority patent/WO2018119588A1/en
Publication of WO2018119588A1 publication Critical patent/WO2018119588A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H3/00Appliances for aiding patients or disabled persons to walk about
    • A61H3/06Walking aids for blind persons
    • A61H3/061Walking aids for blind persons with electronic detecting or guiding means

Definitions

  • the present application relates to the field of information processing technologies of wearable devices, cloud computing, and car networking systems, and in particular, to a method, system, and wearable device for protecting a blind person based on a car network system.
  • Chinese Patent Application No. 201410852790.6 discloses a blind navigation device that communicates with an electronic tag embedded in a blind track.
  • the blind navigation device includes a control module and a tag reader, an inductive switch module and a reminder module electrically connected to the control module, the inductive switch module is configured to sense a change in acceleration of the blind navigation device and sense the The information is transmitted to the control module, and the control module controls the opening and closing of the blind navigation device by sensing the information sensed by the switch module, and the tag reader is configured to receive the information of the electronic tag and transmit the information to the control module.
  • the control module transmits the information of the electronic tag to the reminder module, and the reminder module works according to the information of the electronic tag transmitted by the control module, so that the blind person can travel.
  • the existing blind navigation device needs to communicate with an electronic tag embedded in the blind road.
  • the blind navigation system reads the information of the electronic tag and transmits the information to the Bluetooth earphone, thereby providing road conditions and surrounding environment information for the blind.
  • Voice navigation tips The blind person's convenience measures have limited functions. The blind person needs to walk the blind road to obtain the guidance information, and can only remind the blind person to avoid the obstacle by voice prompt.
  • the blind people have safety hazards in addition to avoiding road obstacles when crossing the zebra crossing or when hitting a moving car or bicycle.
  • the purpose of the embodiments of the present application is to provide a method and system for implementing safe travel for blind people, and a wearable device.
  • the image recognition technology based on the wearable device and the car network system can fully protect the personal safety of the blind person.
  • the blind safe travel implementation system is based on wearable devices, cloud computing, and the Internet of Vehicles In order to realize the blind people in the process of traveling, they can know the objects moving at high speed and issue warnings. They can also carry out hedging control for the fast-moving moving objects (cars) when crossing the road to protect their own lives.
  • an implementation manner of the present application provides a method for implementing a safe travel for a blind, which is applied to a wearable device, including:
  • the on-site reminder device is activated or the remote security protection measures based on the vehicle network are started.
  • the remote security protection measure based on the vehicle network is completed by the cloud server, the vehicle networking module, and the driving system, and determining the current traveling state of the blind person includes identifying an image element in the panoramic image, and identifying the image element and the preset traveling state. Element comparisons determine the status of the trip.
  • the identified image element includes a road zebra crossing
  • the license plate information appearing in the panoramic image is identified, and the identified license plate information is sent to the cloud server.
  • the processing on the server side is: the cloud server searches for the vehicle networking module information corresponding to the license plate information according to the license plate information, and sends a braking message to the corresponding vehicle networking module according to the information of the vehicle networking module.
  • the car is processed as follows: the car networking module is connected with the driving system. After receiving the braking message, the car networking module obtains the current driving speed of the car. When the speed is within the set range, the car networking module voice prompts the user to decelerate; when the speed exceeds When the range is set, the vehicle networking module issues a braking request to the driving system, and the driving system controls the braking mechanism to decelerate.
  • the on-site reminding device is a flashing light, and when the road zebra image element disappears, the flashing light is turned off.
  • a radar speed sensor is also provided to obtain a speed parameter of a moving target around the blind person.
  • an embodiment of the present application further provides a blind travel wearable device, including a processor, and further comprising:
  • Panoramic camera for capturing panoramic images around the blind
  • An image processing module configured to determine a current travel status of the blind person, and identify security information related to the travel status from the panoramic image
  • the processor activates the on-site reminder device or initiates a remote security protection measure based on the Internet of Vehicles according to the security information.
  • the wearable device further includes a preset library of travel status elements, the image processing module is configured to identify image elements in the panoramic image, compare the identified image elements with preset travel status elements, and determine a travel status.
  • the image processing module includes a license plate recognition module for identifying license plate information appearing in the panoramic image when the recognized image element includes a road zebra crossing, and transmitting the recognized license plate information to the cloud server.
  • the live reminding device includes a flashing light and a sound module.
  • the wearable device includes a radar speed sensor to obtain a speed parameter of a moving target around the blind.
  • an embodiment of the present application further provides a blind person safe travel implementation system, including a wearable device, a cloud server, and an in-vehicle system, configured to acquire a panoramic image of a blind person for determining a current travel status of the blind person. And identifying, from the panoramic image, security information related to the travel status, and for initiating the live reminding device according to the security information and transmitting the security information to the cloud server;
  • the cloud server is configured to send a control message to the in-vehicle system according to the security information
  • the in-vehicle system adjusts the travel of the vehicle based on the control message.
  • the wearable device includes a preset library of travel status elements, the image processing module is configured to identify image elements in the panoramic image, compare the identified image elements with preset travel status elements, and determine a travel status; the image processing module
  • the license plate recognition module is configured to identify the license plate information appearing in the panoramic image when the recognized image element includes the road zebra crossing, and send the identified license plate information to the cloud server.
  • the cloud server searches for the vehicle networking module information corresponding to the license plate information according to the license plate information, and sends a braking message to the corresponding vehicle networking module according to the information of the vehicle networking module.
  • the vehicle networking module is connected to a driving system, and the vehicle networking module includes a voice module, and receives the brake After the message, the car networking module obtains the current driving speed of the car. When the speed is within the set range, the voice module prompts the user to decelerate; when the speed exceeds the set range, the car networking module sends a braking request to the driving system, and the driving system controls the braking. The mechanism slows down.
  • the on-site reminding device of the wearable device is a flashing light, and the wearable device turns off the blinking light when the road zebra image element disappears.
  • the wearable device sets a radar speed sensor to obtain a speed parameter of a moving target around the blind.
  • the embodiment of the present application can safely control a traveling object (automobile) that is approaching at a high speed when the blind person crosses the road, and protects his life safety, and recognizes the possibility in the environment based on the image recognition technology of the wearable device. Dangerous safety information occurs, and prompt warning to remind others or through the cloud computing and car networking system, remote security measures to eliminate the dangers of blind people in the environment, fully protect the personal safety of the blind.
  • autonomous traveling object
  • Dangerous safety information occurs, and prompt warning to remind others or through the cloud computing and car networking system, remote security measures to eliminate the dangers of blind people in the environment, fully protect the personal safety of the blind.
  • FIG. 1 is a system block diagram of a blind safe travel implementation system according to the present application.
  • FIG. 2 is a block diagram of a wearable device in accordance with the present application.
  • FIG. 3 is a flow chart of processing a blind person crossing the road in the method for implementing safe travel for blind persons according to the present application;
  • FIG. 5 is a main flowchart of a wearable device according to the method for implementing safe travel for blind people according to the present application
  • FIG. 6 is a flowchart of a system process for implementing a blind safe travel method according to the present application
  • FIG. 7 is a schematic diagram showing the hardware structure of an electronic device for implementing a blind person safe travel method according to an embodiment of the present application.
  • the blind safe travel implementation system of this embodiment of the present application includes a wearable device 100, a cloud server 200, and an in-vehicle system.
  • the wearable device 100 acquires a panoramic image of the blind person, determines a current travel status of the blind person, and identifies safety information related to the travel status from the panoramic image, and activates the on-site reminding device according to the safety information and sends the safety information to the cloud. server.
  • the cloud server 200 transmits a control message to the in-vehicle system according to the security information.
  • the cloud server 200 forms a user data system 220.
  • the registration information includes user information, car networking module information, and car information.
  • the in-vehicle system adjusts the travel of the vehicle based on the control message.
  • the in-vehicle system includes an internetworking module 300 and a driving system 350.
  • the blind travel wearable device includes a processor 110, a panoramic camera 101, a prompting device 104, a sound module 105, an image processing module, and a transmitting module 120 and a receiving module 130.
  • the image processing module includes a face recognition module 102 and a license plate recognition module 103.
  • the face recognition module 102 blurs the face in the captured image when the travel state of the blind user is walking, estimates the flow of people around the blind person, and can inform the blind user through the sound module 105.
  • the panoramic camera 101 is configured to acquire a panoramic image around a blind person.
  • the memory of the wearable device 100 stores a preset library of travel status elements
  • the image processing module is configured to identify image elements in the panoramic image, compare the identified image elements with preset travel status elements, and determine a travel status.
  • the image processing module is further configured to identify security information related to the travel status from the panoramic image.
  • the license plate recognition module 103 identifies the license plate information appearing in the panoramic image when the extracted image element includes a road zebra crossing, and the license plate information is safety information.
  • the transmitting module of the wearable device 110 transmits the identified license plate information to the cloud server 200.
  • the receiving module of the wearable device 110 is configured to receive a feedback message related to remote security protection measures sent from the cloud server.
  • the processor 110 of the wearable device 100 activates the on-site reminder device or initiates a vehicle network-based remote security protection measure according to the security information.
  • the on-site reminding device can be implemented in various manners, and can be a sound or a tactile reminder to the blind user, or a pedestrian who passes the sound and light to remind the passing.
  • the live reminding device includes the sound module 105 and the flashing prompt light.
  • the flashing light is connected to the processor 110.
  • the wearable device 100 turns off the blinking light.
  • the wearable device 100 further includes a radar speed sensor for acquiring a speed parameter of a moving target around the blind person. Through the radar speed sensor, the blind person can know the object moving at high speed during the traveling process.
  • the radar speed sensor acquires the speed of the surrounding identifiable target when the blind person is walking.
  • the sound module 105 is activated to remind the user of the current safety hazard.
  • the license plate recognition module identifies the license plate information appearing in the currently acquired panoramic image, and sends the identified license plate information to the cloud server to start Remote security protection measures based on car networking.
  • the cloud server 200 After receiving the license plate information, the cloud server 200 sends the license plate information to the docking module 210.
  • the docking module 210 verifies the authorization information of the user, and searches for the vehicle networking module information corresponding to the license plate information from the user data system 220, according to the vehicle networking.
  • the module information sends a brake message to the vehicle networking module 300.
  • the vehicle networking module 300 is coupled to a driving system 350 that controls the braking mechanism 352 .
  • the car networking module 300 includes a voice module 310. After the car networking module 300 receives the brake message sent by the cloud server 200, the car network module 300 acquires the current traveling speed of the car and responds to the server's message according to the current speed of the car. When the current speed of the automobile is within the set range, the voice module 310 prompts the driving user to decelerate; when the current speed of the automobile exceeds the set range, the vehicle networking module issues a braking request to the driving system 350, and the driving system 350 controls the braking mechanism 352 to decelerate.
  • vehicle networking module 300 can also be connected to an OBD (On-Board Diagnostic abbreviation) on-board diagnostic system of a car to implement braking by OBD.
  • OBD On-Board Diagnostic abbreviation
  • the remote security protection measure of the embodiment of the present application can provide security protection for blind people and driving users when a blind person using a wearable device crosses the road.
  • the blind user is prepared to pass through the zebra crossing; 1) the wearable device 100 is on the blind body, which may be a guide blind helmet in this embodiment; 2) the wearable device 100 recognizes the zebra crossing image element through the image processing module to realize the detection of the zebra crossing; 3) After the wearable device 100 detects the zebra crossing, the wearable device 100 turns on its own flashing light to make a prompt to the surrounding vehicle; 4) the blind person passes normally from the zebra crossing, and the wearable device 100 continues to detect the surrounding environment and judges Is there a security risk?
  • the wearable device 100 detects no abnormalities in the surrounding area, and the blind person normally passes through the road;
  • the wearable device 100 detects an abnormal situation in the periphery, for example, the radar speed sensor of the wearable device detects that the vehicle with a faster speed approaches;
  • the wearable device 100 completes the license plate recognition, and identifies the license plate information appearing in the image through the image processing module, and the license plate information is a vehicle that is faster and closer to the blind person;
  • the cloud server 200 finds the vehicle network module ID of the vehicle from the user data system through the docking module 210;
  • the cloud server 200 sends a brake message to the vehicle network module of the mobile vehicle for reminding or forcibly braking.
  • the embodiment of the present application further provides a method for implementing safe travel for blind people, which mainly includes:
  • Step 102 Obtain a panoramic image around the blind person
  • Step 104 Determine the current travel status of the blind person
  • Step 106 Identify security information related to the travel status from the panoramic image; the security information is information related to security of the blind user. It may be the speed of the fast moving target of the image recognition, or the license plate number of the traveling vehicle; in order to protect the safety of the blind, the quick response safety hazard, in another embodiment, the speed of the moving target may be completed by the radar speed sensor;
  • Step 108 Start the on-site reminding device according to the security information or initiate remote security protection measures based on the Internet of Vehicles.
  • step 204 shows a specific implementation manner for determining a current travel state of a blind person, the image processing module of the wearable device recognizes an image element in the image, and then identifies the recognized image element with a preset travel status element. Compare and determine the travel status;
  • Step 206 When the travel state is walking, the safety information is a speed parameter of the moving target around the blind obtained by the radar speed sensor, and the speed parameter exceeds the threshold to activate the on-site reminding device; the live reminding device is implemented in various manners, and may be sound or The touch reminds the blind user, or the pedestrian who passes the sound and the light reminder.
  • the live reminding device includes the sound module 105 and the flashing prompt light.
  • Step 208 When the travel status is crossing the road, the safety information is the license plate information identified in the panoramic image, and the remote security protection measure of the vehicle network is started according to the license plate information.
  • Figure 6 shows the details of the technical processing in the cloud and the Internet of Vehicles when the blind crosses the road zebra crossing.
  • Step 302 The processing on the wearable device side is: the wearable device end identifies the image element in the panoramic image acquired by the panoramic camera, and determines whether the image element includes a road zebra crossing; if the image element includes a road zebra crossing, identifies the panoramic image.
  • the license plate information that appears and sends the identified license plate information to the cloud server.
  • Step 304 The processing of the cloud server is: the cloud server searches for the corresponding vehicle network module information from the user data system 220 according to the license plate information sent from the wearable device, and the cloud server sends the brake to the vehicle networking module according to the information of the vehicle networking module. Message. Among them, the cloud server is not directly connected to the driving system to ensure the independence of driving and driving safety.
  • Step 306 The processing in the in-vehicle system is: the in-vehicle system includes the vehicle networking module 300 and the driving system 350. After the car networking module receives the brake message from the cloud server, the car networking module acquires the car. Current driving speed;
  • Step 308 When the current speed of the acquired automobile is within the set range, the voice module 310 of the vehicle networking module prompts the vehicle driving user to decelerate by voice.
  • Step 310 When the current speed of the acquired automobile exceeds the set range, the vehicle networking module issues a braking request to the driving system, and the driving system controls the braking mechanism to forcibly decelerate the vehicle.
  • the blinking light keeps working during the passage of the blind user through the sidewalk.
  • the image processing module of the wearable device recognizes that the road zebra image element disappears, the blinking light is turned off.
  • This patent relates to the field of intelligent robots.
  • sudden encounters occur when a blind person passes through the sidewalk.
  • the vehicle passes the prompt when it does not notice the blind person traveling or the red light.
  • judge trigger the command to reach the cloud for data query, and then directly issue instructions to the fast approaching car for forced braking to ensure the safety of blind and driving users.
  • the wearable device sets a radar speed sensor to quickly acquire the speed of moving the target around the blind, and quickly responds to dangers and prompts to ensure user safety.
  • the wearable device of the present embodiment sets a GPU (Graphics Processing Unit, GPU) and a CPU (Central Processing Unit, CPU) to perform large-data-quantity image recognition operations to ensure fast environment. Identify and respond in a timely manner.
  • the cloud server in the embodiment of the present application queries the user data system through the docking module to ensure the security of the data of the user data system.
  • FIG. 7 is a schematic diagram showing the hardware structure of an electronic device 600 for implementing a blind person's safe travel method according to an embodiment of the present invention.
  • the electronic device 500 includes:
  • the plurality of processors 510, 520 and the memory 530, and the plurality of processors in FIG. 7 are respectively an example of a CPU and a GPU.
  • the processors 510, 520 and the memory 530 may be connected by a bus or other means, as exemplified by a bus connection in FIG.
  • the memory 530 is used as a non-volatile computer readable storage medium, and can be used for storing a non-volatile software program, a non-volatile computer executable program, and a module, as in the blind person safe travel implementation method in the embodiment of the present application.
  • Program instructions/modules eg, image processing module, person shown in Figure 2
  • Face recognition module 102 and license plate recognition module 103 Face recognition module 102 and license plate recognition module 103.
  • the processor 510, 520 executes various functional applications and data processing of the terminal or the server by executing non-volatile software programs, instructions, and modules stored in the memory 530, that is, implementing blind person safe travel in the foregoing method embodiments. method.
  • the memory 530 may include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to the use of the blind safe travel implementation device, and the like. Further, the memory 530 may include a high speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, flash memory device, or other nonvolatile solid state storage device. In some embodiments, memory 530 can optionally include memory remotely located relative to processors 510, 520 that can be connected to the blind safe travel implementation device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • the one or more modules are stored in the memory 530, and when executed by the one or more processors 510, 520, perform a blind safe travel implementation method in any of the above method embodiments, for example, performing the above description
  • the method step 102 to step 110 in FIG. 4, the method step 202 to step 208 in FIG. 5, and the method step 302 to step 310 in FIG. 6 implement the image processing module, the face recognition module 102, and the license plate in FIG.
  • the electronic device of the embodiment of the present application exists in various forms, including but not limited to:
  • Mobile communication devices These devices are characterized by mobile communication functions and are mainly aimed at providing voice and data communication.
  • Such terminals include: smart phones (such as iPhone), multimedia phones, functional phones, and low-end phones.
  • Ultra-mobile personal computer equipment This type of equipment belongs to the category of personal computers, has computing and processing functions, and generally has mobile Internet access.
  • Such terminals include: PDAs, MIDs, and UMPC devices, such as the iPad.
  • Portable entertainment devices These devices can display and play multimedia content.
  • This type of equipment includes: Audio, video players (such as iPod), handheld game consoles, e-books, and smart toys and portable car navigation devices.
  • the server consists of a processor, a hard disk, a memory, a system bus, etc.
  • the server is similar to a general-purpose computer architecture, but because of the need to provide highly reliable services, processing power and stability High reliability in terms of reliability, security, scalability, and manageability.
  • the embodiment of the present application provides a non-transitory computer readable storage medium storing computer-executable instructions that are executed by one or more processors, such as in FIG.
  • the processor 510, 520 may be configured to enable the one or more processors to perform the blind safe travel implementation method in any of the foregoing method embodiments, for example, to perform the method steps 102 to 110 in FIG. 4 described above, FIG.
  • the method steps 202 to 208 and the method steps 302 to 310 in FIG. 6 implement the functions of the image processing module, the face recognition module 102, and the license plate recognition module 103 in FIG. 2, and implement docking of the docking module in FIG. 210 features.
  • the device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

Abstract

A method for realizing a safe trip of a blind person, comprising: acquiring a panoramic image around a blind person (102); determining a current trip state of the blind person (104); identifying safety information relating to the trip state from the panoramic image (106); and starting, according to the safety information, an on-site reminding apparatus (108), or a remote safety protection measure based on Internet of Vehicles (110).

Description

一种盲人安全出行实现方法、系统以及可穿戴设备Method, system and wearable device for implementing blind safe travel 技术领域Technical field
本申请涉及可穿戴设备、云计算以及车联网系统的信息处理技术领域,特别涉及一种基于车联网系统保护盲人安全出行的方法、系统以及可穿戴设备。The present application relates to the field of information processing technologies of wearable devices, cloud computing, and car networking systems, and in particular, to a method, system, and wearable device for protecting a blind person based on a car network system.
背景技术Background technique
随着互联网信息处理技术、通信技术以及半导体硬件的发展,大数据处理分析和传输成为可能,车联网和可穿戴设备应运而生。目前,最普遍的为盲人提供帮助的工具是手杖或者导盲犬,限制了盲人出行范围。With the development of Internet information processing technology, communication technology and semiconductor hardware, big data processing analysis and transmission have become possible, and car networking and wearable devices have emerged. At present, the most common tool for helping the blind is a cane or a guide dog, which limits the range of travel for the blind.
中国专利申请第201410852790.6号披露了一种盲人导航装置,该盲人导航装置及系统,与埋设于盲道的电子标签通信。所述盲人导航装置包括控制模块和与该控制模块电性连接的标签读取器、感应开关模块及提醒模块,该感应开关模块用于感测盲人导航装置的加速度的变化并将感测到的信息传送至该控制模块,该控制模块藉由感应开关模块感测到的信息控制盲人导航装置的开启和关闭,该标签读取器用于接收所述电子标签的信息并传送至所述控制模块,该控制模块将所述电子标签的信息处理后传送至该提醒模块,该提醒模块根据所述控制模块传送的电子标签的信息对应工作,方便盲人出行。Chinese Patent Application No. 201410852790.6 discloses a blind navigation device that communicates with an electronic tag embedded in a blind track. The blind navigation device includes a control module and a tag reader, an inductive switch module and a reminder module electrically connected to the control module, the inductive switch module is configured to sense a change in acceleration of the blind navigation device and sense the The information is transmitted to the control module, and the control module controls the opening and closing of the blind navigation device by sensing the information sensed by the switch module, and the tag reader is configured to receive the information of the electronic tag and transmit the information to the control module. The control module transmits the information of the electronic tag to the reminder module, and the reminder module works according to the information of the electronic tag transmitted by the control module, so that the blind person can travel.
但是现有的盲人导航装置,需与埋设于盲道的电子标签通信,所述的盲人导航系统通过读取电子标签的信息,再将该信息传输至蓝牙耳机,从而为盲人提供路况及周边环境信息的语音导航提示。该种盲人便利措施功能有限,盲人需走盲道才能获取引导信息,并且只能以语音提示的方式提醒盲人避开障碍。但是,在车来车往和人来人往的公共环境,盲人除了避开路面障碍以外在过斑马线时或者碰上行驶的汽车或者自行车时都存在安全隐患。However, the existing blind navigation device needs to communicate with an electronic tag embedded in the blind road. The blind navigation system reads the information of the electronic tag and transmits the information to the Bluetooth earphone, thereby providing road conditions and surrounding environment information for the blind. Voice navigation tips. The blind person's convenience measures have limited functions. The blind person needs to walk the blind road to obtain the guidance information, and can only remind the blind person to avoid the obstacle by voice prompt. However, in the public environment where cars come and go to people, the blind people have safety hazards in addition to avoiding road obstacles when crossing the zebra crossing or when hitting a moving car or bicycle.
因此,现有技术在盲人安全出行保护技术亟待改进。Therefore, the prior art technology for safe travel protection for blind people needs to be improved.
申请内容Application content
本申请实施方式的目的在于提供一种盲人安全出行实现方法、系统以及可穿戴设备,基于可穿戴设备的图像识别技术以及车联网系统,可充分保护盲人的人身安全。该盲人安全出行实现系统基于可穿戴设备、云计算以及车联网系 统,实现盲人在行进过程中可获知身边高速移动的对象,发出警示;并能在过马路时针对高速靠近的行进物体(汽车)进行避险控制,保护自身生命安全。The purpose of the embodiments of the present application is to provide a method and system for implementing safe travel for blind people, and a wearable device. The image recognition technology based on the wearable device and the car network system can fully protect the personal safety of the blind person. The blind safe travel implementation system is based on wearable devices, cloud computing, and the Internet of Vehicles In order to realize the blind people in the process of traveling, they can know the objects moving at high speed and issue warnings. They can also carry out hedging control for the fast-moving moving objects (cars) when crossing the road to protect their own lives.
为解决上述技术问题,第一方面,本申请的实施方式提供了一种盲人安全出行实现方法,应用于可穿戴设备,包括:To solve the above technical problem, in a first aspect, an implementation manner of the present application provides a method for implementing a safe travel for a blind, which is applied to a wearable device, including:
获取盲人周围全景图像;Get a panoramic image of the blind people;
确定该盲人当前出行状态;Determining the current travel status of the blind person;
从该全景图像中识别出于与出行状态有关的安全信息;Identifying security information related to the travel status from the panoramic image;
根据该安全信息启动现场提醒装置或者启动基于车联网的远程安全保护措施。According to the safety information, the on-site reminder device is activated or the remote security protection measures based on the vehicle network are started.
具体地,该基于车联网的远程安全保护措施通过云端服务器、车联网模块以及行车系统完成,确定盲人当前出行状态包括识别该全景图像中的图像元素,将识别的图像元素与预设的出行状态元素比较,确定出行状态。Specifically, the remote security protection measure based on the vehicle network is completed by the cloud server, the vehicle networking module, and the driving system, and determining the current traveling state of the blind person includes identifying an image element in the panoramic image, and identifying the image element and the preset traveling state. Element comparisons determine the status of the trip.
其中,该识别的图像元素包括道路斑马线时,识别该全景图像中出现的车牌信息,并将识别的车牌信息发送至云端服务器。Wherein, when the identified image element includes a road zebra crossing, the license plate information appearing in the panoramic image is identified, and the identified license plate information is sent to the cloud server.
在服务器端的处理为:该云端服务器根据车牌信息查找与车牌信息对应的车联网模块信息,根据该车联网模块信息向对应车联网模块发送刹车消息。The processing on the server side is: the cloud server searches for the vehicle networking module information corresponding to the license plate information according to the license plate information, and sends a braking message to the corresponding vehicle networking module according to the information of the vehicle networking module.
在汽车的处理为:该车联网模块与行车系统连接,收到该刹车消息后,车联网模块获取汽车当前行驶速度,当速度在设定范围时,车联网模块语音提示用户减速;当速度超出设定范围时,车联网模块向行车系统发出刹车请求,该行车系统控制刹车机构减速。The car is processed as follows: the car networking module is connected with the driving system. After receiving the braking message, the car networking module obtains the current driving speed of the car. When the speed is within the set range, the car networking module voice prompts the user to decelerate; when the speed exceeds When the range is set, the vehicle networking module issues a braking request to the driving system, and the driving system controls the braking mechanism to decelerate.
作为一种实施方式,该现场提醒装置为闪烁提示灯,该道路斑马线图像元素消失时,关闭该闪烁提示灯。In an embodiment, the on-site reminding device is a flashing light, and when the road zebra image element disappears, the flashing light is turned off.
优选的,还设置雷达测速传感器以获取盲人周围移动目标的速度参数。Preferably, a radar speed sensor is also provided to obtain a speed parameter of a moving target around the blind person.
第二方面,本申请的实施方式还提供了一种盲人出行可穿戴设备,包括处理器,还包括:In a second aspect, an embodiment of the present application further provides a blind travel wearable device, including a processor, and further comprising:
全景摄像头,用于获取盲人周围全景图像; Panoramic camera for capturing panoramic images around the blind;
图像处理模块,用于确定盲人当前出行状态,并从该全景图像中识别出于与出行状态有关的安全信息;An image processing module, configured to determine a current travel status of the blind person, and identify security information related to the travel status from the panoramic image;
其中,该处理器根据该安全信息启动现场提醒装置或者启动基于车联网的远程安全保护措施。The processor activates the on-site reminder device or initiates a remote security protection measure based on the Internet of Vehicles according to the security information.
该可穿戴设备还包括预设的出行状态元素库,该图像处理模块用于识别该全景图像中的图像元素,将识别的图像元素与预设的出行状态元素比较,确定出行状态。The wearable device further includes a preset library of travel status elements, the image processing module is configured to identify image elements in the panoramic image, compare the identified image elements with preset travel status elements, and determine a travel status.
该图像处理模块包括车牌识别模块,用于在该识别的图像元素包括道路斑马线时,识别该全景图像中出现的车牌信息,并将识别的车牌信息发送至云端服务器。The image processing module includes a license plate recognition module for identifying license plate information appearing in the panoramic image when the recognized image element includes a road zebra crossing, and transmitting the recognized license plate information to the cloud server.
作为一种实施方式,该现场提醒装置包括闪烁提示灯和声音模块。As an embodiment, the live reminding device includes a flashing light and a sound module.
该可穿戴设备包括雷达测速传感器以获取盲人周围移动目标的速度参数。The wearable device includes a radar speed sensor to obtain a speed parameter of a moving target around the blind.
第三方面,本申请的实施方式还提供了一种盲人安全出行实现系统,包括可穿戴设备、云端服务器以及车载系统,该可穿戴设备用于获取盲人周围全景图像,用于确定盲人当前出行状态并从该全景图像中识别出于与出行状态有关的安全信息,以及用于根据该安全信息启动现场提醒装置并将该安全信息发送至云端服务器;In a third aspect, an embodiment of the present application further provides a blind person safe travel implementation system, including a wearable device, a cloud server, and an in-vehicle system, configured to acquire a panoramic image of a blind person for determining a current travel status of the blind person. And identifying, from the panoramic image, security information related to the travel status, and for initiating the live reminding device according to the security information and transmitting the security information to the cloud server;
该云端服务器用于根据该安全信息向该车载系统发送控制消息;The cloud server is configured to send a control message to the in-vehicle system according to the security information;
该车载系统根据该控制消息调整车辆的行驶。The in-vehicle system adjusts the travel of the vehicle based on the control message.
该可穿戴设备包括预设的出行状态元素库,该图像处理模块用于识别该全景图像中的图像元素,将识别的图像元素与预设的出行状态元素比较,确定出行状态;该图像处理模块包括车牌识别模块,用于在该识别的图像元素包括道路斑马线时,识别该全景图像中出现的车牌信息,并将识别的车牌信息发送至云端服务器。The wearable device includes a preset library of travel status elements, the image processing module is configured to identify image elements in the panoramic image, compare the identified image elements with preset travel status elements, and determine a travel status; the image processing module The license plate recognition module is configured to identify the license plate information appearing in the panoramic image when the recognized image element includes the road zebra crossing, and send the identified license plate information to the cloud server.
该云端服务器根据车牌信息查找与车牌信息对应的车联网模块信息,根据该车联网模块信息向对应车联网模块发送刹车消息。The cloud server searches for the vehicle networking module information corresponding to the license plate information according to the license plate information, and sends a braking message to the corresponding vehicle networking module according to the information of the vehicle networking module.
该车联网模块与行车系统连接,该车联网模块包括语音模块,收到该刹车 消息后,车联网模块获取汽车当前行驶速度,当速度在设定范围时,该语音模块提示用户减速;当速度超出设定范围时,车联网模块向行车系统发出刹车请求,该行车系统控制刹车机构减速。The vehicle networking module is connected to a driving system, and the vehicle networking module includes a voice module, and receives the brake After the message, the car networking module obtains the current driving speed of the car. When the speed is within the set range, the voice module prompts the user to decelerate; when the speed exceeds the set range, the car networking module sends a braking request to the driving system, and the driving system controls the braking. The mechanism slows down.
该可穿戴设备的现场提醒装置为闪烁提示灯,该道路斑马线图像元素消失时,该可穿戴设备关闭该闪烁提示灯。The on-site reminding device of the wearable device is a flashing light, and the wearable device turns off the blinking light when the road zebra image element disappears.
该可穿戴设备设置雷达测速传感器以获取盲人周围移动目标的速度参数。The wearable device sets a radar speed sensor to obtain a speed parameter of a moving target around the blind.
本申请实施方式相对于现有技术而言,能在盲人过马路时针对高速靠近的行进物体(汽车)进行避险控制,保护自身生命安全,基于可穿戴设备的图像识别技术识别环境中的可能发生危险的安全信息,并及时预警提醒他人或者通过云计算与车联网系统,采取远程安全保护措施,排除了盲人外出环境中出现的危险,充分保护盲人的人身安全。Compared with the prior art, the embodiment of the present application can safely control a traveling object (automobile) that is approaching at a high speed when the blind person crosses the road, and protects his life safety, and recognizes the possibility in the environment based on the image recognition technology of the wearable device. Dangerous safety information occurs, and prompt warning to remind others or through the cloud computing and car networking system, remote security measures to eliminate the dangers of blind people in the environment, fully protect the personal safety of the blind.
附图说明DRAWINGS
一个或多个实施例通过与之对应的附图中的图片进行示例性说明,这些示例性说明并不构成对实施例的限定,附图中具有相同参考数字标号的元件表示为类似的元件,除非有特别申明,附图中的图不构成比例限制。The one or more embodiments are exemplified by the accompanying drawings in the accompanying drawings, and FIG. The figures in the drawings do not constitute a scale limitation unless otherwise stated.
图1是根据本申请盲人安全出行实现系统的系统模块图;1 is a system block diagram of a blind safe travel implementation system according to the present application;
图2是根据本申请可穿戴设备的模块图;2 is a block diagram of a wearable device in accordance with the present application;
图3是根据本申请盲人安全出行实现方法中盲人过马路的处理流程图;3 is a flow chart of processing a blind person crossing the road in the method for implementing safe travel for blind persons according to the present application;
图4是根据本申请盲人安全出行实现方法的主要流程图;4 is a main flow chart of a method for implementing safe travel for blind people according to the present application;
图5是根据本申请盲人安全出行实现方法的可穿戴设备的主要流程图;5 is a main flowchart of a wearable device according to the method for implementing safe travel for blind people according to the present application;
图6是根据本申请盲人安全出行实现方法的系统处理流程图;以及6 is a flowchart of a system process for implementing a blind safe travel method according to the present application;
图7是本申请实施例提供的盲人安全出行实现方法的电子设备的硬件结构示意图。FIG. 7 is a schematic diagram showing the hardware structure of an electronic device for implementing a blind person safe travel method according to an embodiment of the present application.
具体实施方式 detailed description
为使本申请实施方式的目的、技术方案和优点更加清楚,下面将结合附图对本申请的各实施方式进行详细的阐述。然而,本领域的普通技术人员可以理解,在本申请各实施方式中,为了使读者更好地理解本申请而提出了许多技术细节。但是,即使没有这些技术细节和基于以下各实施方式的种种变化和修改,也可以实现本申请所要求保护的技术方案。The embodiments of the present application will be described in detail below with reference to the accompanying drawings. However, those skilled in the art will appreciate that in the various embodiments of the present application, numerous technical details are set forth in order to provide the reader with a better understanding of the application. However, the technical solutions claimed in the present application can be implemented without these technical details and various changes and modifications based on the following embodiments.
如图1所示,本申请本实施例的盲人安全出行实现系统包括可穿戴设备100、云端服务器200以及车载系统。As shown in FIG. 1 , the blind safe travel implementation system of this embodiment of the present application includes a wearable device 100, a cloud server 200, and an in-vehicle system.
该可穿戴设备100获取盲人周围全景图像,确定盲人当前出行状态并从该全景图像中识别出于与出行状态有关的安全信息,以及根据该安全信息启动现场提醒装置并将该安全信息发送至云端服务器。The wearable device 100 acquires a panoramic image of the blind person, determines a current travel status of the blind person, and identifies safety information related to the travel status from the panoramic image, and activates the on-site reminding device according to the safety information and sends the safety information to the cloud. server.
该云端服务器200根据该安全信息向该车载系统发送控制消息。The cloud server 200 transmits a control message to the in-vehicle system according to the security information.
汽车用户以及可穿戴设备的盲人用户均预先在云端服务器200注册。该云端服务器200形成用户数据系统220。其中注册信息包括用户信息、车联网模块信息以及汽车信息。Both the car user and the blind user of the wearable device are registered in advance in the cloud server 200. The cloud server 200 forms a user data system 220. The registration information includes user information, car networking module information, and car information.
该车载系统根据该控制消息调整车辆的行驶。该车载系统包括车联网模块300和行车系统350。The in-vehicle system adjusts the travel of the vehicle based on the control message. The in-vehicle system includes an internetworking module 300 and a driving system 350.
请参考图2,该盲人出行可穿戴设备,包括处理器110、全景摄像头101、提示装置104、声音模块105、图像处理模块、以及发送模块120和接收模块130。Referring to FIG. 2, the blind travel wearable device includes a processor 110, a panoramic camera 101, a prompting device 104, a sound module 105, an image processing module, and a transmitting module 120 and a receiving module 130.
该图像处理模块包括人脸识别模块102以及车牌识别模块103。该人脸识别模块102在盲人用户的出行状态为行走时,模糊识别采集图像中的人脸,预估盲人四周的人流情况,并可通过声音模块105语音告知盲人用户。The image processing module includes a face recognition module 102 and a license plate recognition module 103. The face recognition module 102 blurs the face in the captured image when the travel state of the blind user is walking, estimates the flow of people around the blind person, and can inform the blind user through the sound module 105.
该全景摄像头101,用于获取盲人周围全景图像。The panoramic camera 101 is configured to acquire a panoramic image around a blind person.
该可穿戴设备100的存储器存储有预设的出行状态元素库,该图像处理模块用于识别该全景图像中的图像元素,将识别的图像元素与预设的出行状态元素比较,确定出行状态。该图像处理模块还用于从该全景图像中识别出于与出行状态有关的安全信息。比如,该车牌识别模块103在该提取的图像元素包括道路斑马线时,识别该全景图像中出现的车牌信息,该车牌信息即为安全信息。 该可穿戴设备110的发送模块将识别的车牌信息发送至云端服务器200。该可穿戴设备110的接收模块用于接收从云端服务器发送来的与远程安全保护措施相关的反馈消息。The memory of the wearable device 100 stores a preset library of travel status elements, the image processing module is configured to identify image elements in the panoramic image, compare the identified image elements with preset travel status elements, and determine a travel status. The image processing module is further configured to identify security information related to the travel status from the panoramic image. For example, the license plate recognition module 103 identifies the license plate information appearing in the panoramic image when the extracted image element includes a road zebra crossing, and the license plate information is safety information. The transmitting module of the wearable device 110 transmits the identified license plate information to the cloud server 200. The receiving module of the wearable device 110 is configured to receive a feedback message related to remote security protection measures sent from the cloud server.
该可穿戴设备100的处理器110根据该安全信息启动现场提醒装置或者启动基于车联网的远程安全保护措施。The processor 110 of the wearable device 100 activates the on-site reminder device or initiates a vehicle network-based remote security protection measure according to the security information.
该现场提醒装置的实现方式有多种,可以是声音或者触觉提醒盲人用户,或者是声音和光线提醒路过的行人,在本实施例中,该现场提醒装置包括声音模块105和闪烁提示灯。The on-site reminding device can be implemented in various manners, and can be a sound or a tactile reminder to the blind user, or a pedestrian who passes the sound and light to remind the passing. In the embodiment, the live reminding device includes the sound module 105 and the flashing prompt light.
其中,该闪烁提示灯连接处理器110,当图像处理模块反馈给处理器110采集的道路斑马线图像元素消失时,该可穿戴设备100关闭该闪烁提示灯。The flashing light is connected to the processor 110. When the image processing module returns to the road zebra image element collected by the processor 110, the wearable device 100 turns off the blinking light.
该可穿戴设备100还包括雷达测速传感器,该雷达测速传感器用以获取盲人周围移动目标的速度参数。通过雷达测速传感器实现盲人在行进过程中获知身边高速移动的对象。The wearable device 100 further includes a radar speed sensor for acquiring a speed parameter of a moving target around the blind person. Through the radar speed sensor, the blind person can know the object moving at high speed during the traveling process.
其中,当盲人在行走时,该雷达测速传感器获取四周可识别目标的速度,当获取的某一目标的速度参数超过阈值时,则启动声音模块105提醒使用者当前存在的安全隐患。The radar speed sensor acquires the speed of the surrounding identifiable target when the blind person is walking. When the acquired speed parameter of a certain target exceeds the threshold, the sound module 105 is activated to remind the user of the current safety hazard.
当用户的出行状态为过马路时,也就是提取的图像元素包括道路斑马线时,该车牌识别模块识别当前获取的全景图像中出现的车牌信息,并将识别的车牌信息发送至云端服务器,以启动基于车联网的远程安全保护措施。When the travel status of the user is crossing the road, that is, when the extracted image element includes the road zebra crossing, the license plate recognition module identifies the license plate information appearing in the currently acquired panoramic image, and sends the identified license plate information to the cloud server to start Remote security protection measures based on car networking.
该云端服务器200收到车牌信息后,将车牌信息发送至对接模块210,该对接模块210核实用户的授权信息,从用户数据系统220中查找与车牌信息对应的车联网模块信息,根据该车联网模块信息向车联网模块300发送刹车消息。After receiving the license plate information, the cloud server 200 sends the license plate information to the docking module 210. The docking module 210 verifies the authorization information of the user, and searches for the vehicle networking module information corresponding to the license plate information from the user data system 220, according to the vehicle networking. The module information sends a brake message to the vehicle networking module 300.
请进一步参考图1,该车联网模块300与行车系统350连接,该行车系统350控制刹车机构352。该车联网模块300包括语音模块310。该车联网模块300收到云端服务器200发送的刹车消息后,车联网模块300获取汽车当前行驶速度,并根据汽车当前的速度响应服务器的消息。当汽车当前速度在设定范围时,该语音模块310提示驾驶用户减速;当汽车当前速度超出设定范围时,车联网模块向行车系统350发出刹车请求,该行车系统350控制刹车机构352减速。 Referring further to FIG. 1 , the vehicle networking module 300 is coupled to a driving system 350 that controls the braking mechanism 352 . The car networking module 300 includes a voice module 310. After the car networking module 300 receives the brake message sent by the cloud server 200, the car network module 300 acquires the current traveling speed of the car and responds to the server's message according to the current speed of the car. When the current speed of the automobile is within the set range, the voice module 310 prompts the driving user to decelerate; when the current speed of the automobile exceeds the set range, the vehicle networking module issues a braking request to the driving system 350, and the driving system 350 controls the braking mechanism 352 to decelerate.
对于一般技术人员来说,可以理解的是,该车联网模块300也可以与汽车的OBD(On-Board Diagnostic的缩写)车载诊断系统连接,通过OBD实现刹车。It can be understood by a person of ordinary skill that the vehicle networking module 300 can also be connected to an OBD (On-Board Diagnostic abbreviation) on-board diagnostic system of a car to implement braking by OBD.
请参考图3,本申请实施例的远程安全保护措施在使用可穿戴设备的盲人过马路时,可为盲人和驾驶用户提供安全防护。Referring to FIG. 3, the remote security protection measure of the embodiment of the present application can provide security protection for blind people and driving users when a blind person using a wearable device crosses the road.
盲人用户准备穿过斑马线;1)盲人身体上有可穿戴设备100,本实施例中可以是导盲头盔;2)可穿戴设备100通过图像处理模块识别出斑马线图像元素,实现对斑马线的探测;3)当可穿戴设备100探测到斑马线后,可穿戴设备100打开自身的闪烁提示灯,从而进行对周边车辆的提示;4)盲人从斑马线正常通行,同时可穿戴设备100继续探测周边环境,判断是否存在安全隐患。The blind user is prepared to pass through the zebra crossing; 1) the wearable device 100 is on the blind body, which may be a guide blind helmet in this embodiment; 2) the wearable device 100 recognizes the zebra crossing image element through the image processing module to realize the detection of the zebra crossing; 3) After the wearable device 100 detects the zebra crossing, the wearable device 100 turns on its own flashing light to make a prompt to the surrounding vehicle; 4) the blind person passes normally from the zebra crossing, and the wearable device 100 continues to detect the surrounding environment and judges Is there a security risk?
请参考图3,过马路的具体防护过程说明如下:Please refer to Figure 3, the specific protection process of crossing the road is as follows:
4-1-1)可穿戴设备100探测周边无异常情况,盲人正常通过马路;4-1-1) The wearable device 100 detects no abnormalities in the surrounding area, and the blind person normally passes through the road;
4-1-2)盲人通过马路后闪烁提示灯自然关闭;4-1-2) When the blind person passes the road, the flashing light is naturally turned off;
4-2-1)若可穿戴设备100探测周边有异常情况,比如可穿戴设备的雷达测速传感器探测到速度较快的车辆靠近;4-2-1) If the wearable device 100 detects an abnormal situation in the periphery, for example, the radar speed sensor of the wearable device detects that the vehicle with a faster speed approaches;
4-2-2)可穿戴设备100完成车牌识别,通过图像处理模块识别图像中出现的车牌信息,该车牌信息为速度较快靠近盲人的车辆;4-2-2) The wearable device 100 completes the license plate recognition, and identifies the license plate information appearing in the image through the image processing module, and the license plate information is a vehicle that is faster and closer to the blind person;
4-2-3)发送车牌信息到云端服务器200;4-2-3) sending license plate information to the cloud server 200;
4-2-4)云端服务器200通过对接模块210从用户数据系统中找出车辆的车联网模块ID;4-2-4) The cloud server 200 finds the vehicle network module ID of the vehicle from the user data system through the docking module 210;
4-2-5)通过车联网技术,云端服务器200下发刹车信息到移动车辆的车联网模块进行提醒或者强行制动。4-2-5) Through the vehicle networking technology, the cloud server 200 sends a brake message to the vehicle network module of the mobile vehicle for reminding or forcibly braking.
请一并参考图4、图5,本申请实施例还提供一种盲人安全出行实现方法,主要包括:Please refer to FIG. 4 and FIG. 5 together. The embodiment of the present application further provides a method for implementing safe travel for blind people, which mainly includes:
步骤102:获取盲人周围全景图像;Step 102: Obtain a panoramic image around the blind person;
步骤104:确定盲人当前出行状态; Step 104: Determine the current travel status of the blind person;
步骤106:从该全景图像中识别出于与出行状态有关的安全信息;该安全信息为与盲人用户安全相关的信息。可以是图像识别的快速移动目标的速度,或者行驶车辆的车牌号码;为了保护盲人安全,快速反应安全隐患,在另一实施方式中,该移动目标的速度可以由雷达测速传感器完成;Step 106: Identify security information related to the travel status from the panoramic image; the security information is information related to security of the blind user. It may be the speed of the fast moving target of the image recognition, or the license plate number of the traveling vehicle; in order to protect the safety of the blind, the quick response safety hazard, in another embodiment, the speed of the moving target may be completed by the radar speed sensor;
步骤108:根据该安全信息启动现场提醒装置或者启动基于车联网的远程安全保护措施。Step 108: Start the on-site reminding device according to the security information or initiate remote security protection measures based on the Internet of Vehicles.
如图5所示,步骤204:所示为确定盲人当前出行状态的具体实施方式,可穿戴设备的图像处理模块识别出图像中的图像元素,再将识别的图像元素与预设的出行状态元素比较,确定出行状态;As shown in FIG. 5, step 204: shows a specific implementation manner for determining a current travel state of a blind person, the image processing module of the wearable device recognizes an image element in the image, and then identifies the recognized image element with a preset travel status element. Compare and determine the travel status;
步骤206:出行状态为行走时,安全信息为雷达测速传感器获取的盲人周围移动目标的速度参数,该速度参数超过阈值启动现场提醒装置;该现场提醒装置的实现方式有多种,可以是声音或者触觉提醒盲人用户,或者是声音和光线提醒路过的行人,在本实施例中,该现场提醒装置包括声音模块105和闪烁提示灯。Step 206: When the travel state is walking, the safety information is a speed parameter of the moving target around the blind obtained by the radar speed sensor, and the speed parameter exceeds the threshold to activate the on-site reminding device; the live reminding device is implemented in various manners, and may be sound or The touch reminds the blind user, or the pedestrian who passes the sound and the light reminder. In the embodiment, the live reminding device includes the sound module 105 and the flashing prompt light.
步骤208:出行状态为过马路时,安全信息为该全景图像中识别的车牌信息,根据该车牌信息启动于车联网的远程安全保护措施。Step 208: When the travel status is crossing the road, the safety information is the license plate information identified in the panoramic image, and the remote security protection measure of the vehicle network is started according to the license plate information.
请参考图6,所示为盲人过马路斑马线时,在云端和车联网端的技术处理细节。Please refer to Figure 6, which shows the details of the technical processing in the cloud and the Internet of Vehicles when the blind crosses the road zebra crossing.
步骤302:在可穿戴设备端的处理为:可穿戴设备端识别全景摄像头获取的全景图像中的图像元素,并判断图像元素是否包括道路斑马线;如果图像元素包括了道路斑马线,则识别该全景图像中出现的车牌信息,并将识别的车牌信息发送至云端服务器。Step 302: The processing on the wearable device side is: the wearable device end identifies the image element in the panoramic image acquired by the panoramic camera, and determines whether the image element includes a road zebra crossing; if the image element includes a road zebra crossing, identifies the panoramic image. The license plate information that appears and sends the identified license plate information to the cloud server.
步骤304:在云端服务器的处理为:云端服务器根据从可穿戴设备发送来的车牌信息从用户数据系统220查找对应的车联网模块信息,云端服务器根据该车联网模块信息向该车联网模块发送刹车消息。其中,云端服务器并不直接与行车系统互联互通,以保证车辆行驶的独立性和行车安全。Step 304: The processing of the cloud server is: the cloud server searches for the corresponding vehicle network module information from the user data system 220 according to the license plate information sent from the wearable device, and the cloud server sends the brake to the vehicle networking module according to the information of the vehicle networking module. Message. Among them, the cloud server is not directly connected to the driving system to ensure the independence of driving and driving safety.
步骤306:在车载系统的处理为:该车载系统包括车联网模块300和行车系统350。该车联网模块收到来自云端服务器的刹车消息后,车联网模块获取汽车 当前行驶速度;Step 306: The processing in the in-vehicle system is: the in-vehicle system includes the vehicle networking module 300 and the driving system 350. After the car networking module receives the brake message from the cloud server, the car networking module acquires the car. Current driving speed;
步骤308:当获取的汽车当前速度在设定范围时,车联网模块的语音模块310通过语音提示车辆驾驶用户减速。Step 308: When the current speed of the acquired automobile is within the set range, the voice module 310 of the vehicle networking module prompts the vehicle driving user to decelerate by voice.
步骤310:当获取的汽车当前速度超出设定范围时,车联网模块向行车系统发出刹车请求,该行车系统控制刹车机构使车辆强制减速。Step 310: When the current speed of the acquired automobile exceeds the set range, the vehicle networking module issues a braking request to the driving system, and the driving system controls the braking mechanism to forcibly decelerate the vehicle.
此后,盲人用户可继续安全通过人行道。Thereafter, blind users can continue to safely pass through the sidewalk.
在盲人用户通过人行道的过程中,该闪烁提示灯一直工作,当可穿戴设备的图像处理模块识别出该道路斑马线图像元素消失时,关闭该闪烁提示灯。The blinking light keeps working during the passage of the blind user through the sidewalk. When the image processing module of the wearable device recognizes that the road zebra image element disappears, the blinking light is turned off.
本专利涉及智能机器人领域,基于可穿戴设备、云计算、车载系统,在盲人通过人行道过程中遇到突发性的情况,例如:车辆在没有注意到盲人行进或者闯红灯等异常情况下,通过提示、判断、触发指令到达云端进行数据查询,然后直接下发指令到快速逼近的汽车进行强制制动,以保障盲人和驾驶用户的安全。同时,在一实施例中,该可穿戴设备设置雷达测速传感器以快速获取盲人周围移动目标的速度,快速响应危险和提示,保证用户安全。并且,本实施例的可穿戴设备,设置GPU(Graphics Processing Unit,缩写:GPU)和CUP(Central Processing Unit,缩写:CPU)多个处理完成大数据量的图像识别运算,可保证对环境的快速识别和及时响应。本申请实施例中的云端服务器通过对接模块查询用户数据系统,保证用户数据系统数据的安全。This patent relates to the field of intelligent robots. Based on wearable devices, cloud computing, and in-vehicle systems, sudden encounters occur when a blind person passes through the sidewalk. For example, the vehicle passes the prompt when it does not notice the blind person traveling or the red light. , judge, trigger the command to reach the cloud for data query, and then directly issue instructions to the fast approaching car for forced braking to ensure the safety of blind and driving users. Meanwhile, in an embodiment, the wearable device sets a radar speed sensor to quickly acquire the speed of moving the target around the blind, and quickly responds to dangers and prompts to ensure user safety. In addition, the wearable device of the present embodiment sets a GPU (Graphics Processing Unit, GPU) and a CPU (Central Processing Unit, CPU) to perform large-data-quantity image recognition operations to ensure fast environment. Identify and respond in a timely manner. The cloud server in the embodiment of the present application queries the user data system through the docking module to ensure the security of the data of the user data system.
图7是本申请实施例提供的盲人安全出行实现方法的电子设备600的硬件结构示意图,如图7所示,该电子设备500包括:FIG. 7 is a schematic diagram showing the hardware structure of an electronic device 600 for implementing a blind person's safe travel method according to an embodiment of the present invention. As shown in FIG. 7, the electronic device 500 includes:
多个处理器510、520以及存储器530,图7中的多个处理器分别为CPU和GPU为例。The plurality of processors 510, 520 and the memory 530, and the plurality of processors in FIG. 7 are respectively an example of a CPU and a GPU.
处理器510、520和存储器530可以通过总线或者其他方式连接,图7中以通过总线连接为例。The processors 510, 520 and the memory 530 may be connected by a bus or other means, as exemplified by a bus connection in FIG.
存储器530作为一种非易失性计算机可读存储介质,可用于存储非易失性软件程序、非易失性计算机可执行程序以及模块,如本申请实施例中的盲人安全出行实现方法对应的程序指令/模块(例如,附图2所示的图像处理模块、人 脸识别模块102以及车牌识别模块103)。处理器510、520通过运行存储在存储器530中的非易失性软件程序、指令以及模块,从而执行终端或者服务器的各种功能应用以及数据处理,即实现上述方法实施例中的盲人安全出行实现方法。The memory 530 is used as a non-volatile computer readable storage medium, and can be used for storing a non-volatile software program, a non-volatile computer executable program, and a module, as in the blind person safe travel implementation method in the embodiment of the present application. Program instructions/modules (eg, image processing module, person shown in Figure 2) Face recognition module 102 and license plate recognition module 103). The processor 510, 520 executes various functional applications and data processing of the terminal or the server by executing non-volatile software programs, instructions, and modules stored in the memory 530, that is, implementing blind person safe travel in the foregoing method embodiments. method.
存储器530可以包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需要的应用程序;存储数据区可存储根据盲人安全出行实现装置的使用所创建的数据等。此外,存储器530可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实施例中,存储器530可选包括相对于处理器510、520远程设置的存储器,这些远程存储器可以通过网络连接至盲人安全出行实现装置。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 530 may include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to the use of the blind safe travel implementation device, and the like. Further, the memory 530 may include a high speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, flash memory device, or other nonvolatile solid state storage device. In some embodiments, memory 530 can optionally include memory remotely located relative to processors 510, 520 that can be connected to the blind safe travel implementation device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
所述一个或者多个模块存储在所述存储器530中,当被所述一个或者多个处理器510、520执行时,执行上述任意方法实施例中的盲人安全出行实现方法,例如,执行以上描述的图4中的方法步骤102至步骤110,图5中的方法步骤202至步骤208以及图6中的方法步骤302至步骤310,实现图2中的图像处理模块、人脸识别模块102以及车牌识别模块103的功能,和实现图1中对接模块对接210的功能。The one or more modules are stored in the memory 530, and when executed by the one or more processors 510, 520, perform a blind safe travel implementation method in any of the above method embodiments, for example, performing the above description The method step 102 to step 110 in FIG. 4, the method step 202 to step 208 in FIG. 5, and the method step 302 to step 310 in FIG. 6 implement the image processing module, the face recognition module 102, and the license plate in FIG. The function of the identification module 103 and the function of implementing the docking module docking 210 in FIG.
上述产品可执行本申请实施例所提供的方法,具备执行方法相应的功能模块和有益效果。未在本实施例中详尽描述的技术细节,可参见本申请实施例所提供的方法。The above products can perform the methods provided by the embodiments of the present application, and have the corresponding functional modules and beneficial effects of the execution method. For technical details that are not described in detail in this embodiment, reference may be made to the method provided by the embodiments of the present application.
本申请实施例的电子设备以多种形式存在,包括但不限于:The electronic device of the embodiment of the present application exists in various forms, including but not limited to:
(1)移动通信设备:这类设备的特点是具备移动通信功能,并且以提供话音、数据通信为主要目标。这类终端包括:智能手机(例如iPhone)、多媒体手机、功能性手机,以及低端手机等。(1) Mobile communication devices: These devices are characterized by mobile communication functions and are mainly aimed at providing voice and data communication. Such terminals include: smart phones (such as iPhone), multimedia phones, functional phones, and low-end phones.
(2)超移动个人计算机设备:这类设备属于个人计算机的范畴,有计算和处理功能,一般也具备移动上网特性。这类终端包括:PDA、MID和UMPC设备等,例如iPad。(2) Ultra-mobile personal computer equipment: This type of equipment belongs to the category of personal computers, has computing and processing functions, and generally has mobile Internet access. Such terminals include: PDAs, MIDs, and UMPC devices, such as the iPad.
(3)便携式娱乐设备:这类设备可以显示和播放多媒体内容。该类设备包括: 音频、视频播放器(例如iPod),掌上游戏机,电子书,以及智能玩具和便携式车载导航设备。(3) Portable entertainment devices: These devices can display and play multimedia content. This type of equipment includes: Audio, video players (such as iPod), handheld game consoles, e-books, and smart toys and portable car navigation devices.
(4)服务器:提供计算服务的设备,服务器的构成包括处理器、硬盘、内存、系统总线等,服务器和通用的计算机架构类似,但是由于需要提供高可靠的服务,因此在处理能力、稳定性、可靠性、安全性、可扩展性、可管理性等方面要求较高。(4) Server: A device that provides computing services. The server consists of a processor, a hard disk, a memory, a system bus, etc. The server is similar to a general-purpose computer architecture, but because of the need to provide highly reliable services, processing power and stability High reliability in terms of reliability, security, scalability, and manageability.
(5)其他具有数据交互功能的电子装置。(5) Other electronic devices with data interaction functions.
本申请实施例提供了一种非易失性计算机可读存储介质,所述计算机可读存储介质存储有计算机可执行指令,该计算机可执行指令被一个或多个处理器执行,例如图7中的处理器510、520,可使得上述一个或多个处理器可执行上述任意方法实施例中的盲人安全出行实现方法,例如,执行以上描述的图4中的方法步骤102至步骤110,图5中的方法步骤202至步骤208以及图6中的方法步骤302至步骤310,实现图2中的图像处理模块、人脸识别模块102以及车牌识别模块103的功能,和实现图1中对接模块对接210的功能。The embodiment of the present application provides a non-transitory computer readable storage medium storing computer-executable instructions that are executed by one or more processors, such as in FIG. The processor 510, 520 may be configured to enable the one or more processors to perform the blind safe travel implementation method in any of the foregoing method embodiments, for example, to perform the method steps 102 to 110 in FIG. 4 described above, FIG. The method steps 202 to 208 and the method steps 302 to 310 in FIG. 6 implement the functions of the image processing module, the face recognition module 102, and the license plate recognition module 103 in FIG. 2, and implement docking of the docking module in FIG. 210 features.
以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
通过以上的实施方式的描述,本领域普通技术人员可以清楚地了解到各实施方式可借助软件加通用硬件平台的方式来实现,当然也可以通过硬件。本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory,RAM)等。Through the description of the above embodiments, those skilled in the art can clearly understand that the various embodiments can be implemented by means of software plus a general hardware platform, and of course, by hardware. A person skilled in the art can understand that all or part of the process of implementing the above embodiments can be completed by a computer program to instruct related hardware, and the program can be stored in a computer readable storage medium. When executed, the flow of an embodiment of the methods as described above may be included. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).
最后应说明的是:以上实施例仅用以说明本申请的技术方案,而非对其限制;在本申请的思路下,以上实施例或者不同实施例中的技术特征之间也可以 进行组合,步骤可以以任意顺序实现,并存在如上所述的本申请的不同方面的许多其它变化,为了简明,它们没有在细节中提供;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。 Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, and are not limited thereto; under the idea of the present application, the technical features in the above embodiments or different embodiments may also be The combination may be carried out in any order, and there are many other variations of the various aspects of the present application as described above, which are not provided in the details for the sake of brevity; although the present application has been described in detail with reference to the foregoing embodiments, It should be understood by those skilled in the art that the technical solutions described in the foregoing embodiments may be modified or equivalently replaced with some of the technical features; and the modifications or substitutions do not deviate from the essence of the corresponding technical solutions. The scope of the technical solutions of the various embodiments is applied.

Claims (18)

  1. 一种盲人安全出行实现方法,其特征在于,应用于可穿戴设备,包括:A blind person safe travel implementation method, characterized in that, applied to a wearable device, comprising:
    获取盲人周围全景图像;Get a panoramic image of the blind people;
    确定所述盲人当前出行状态;Determining the current travel status of the blind person;
    从所述全景图像中识别出于与出行状态有关的安全信息;Identifying security information related to the travel status from the panoramic image;
    根据所述安全信息启动现场提醒装置或者启动基于车联网的远程安全保护措施。Initiating an on-site reminder device according to the security information or initiating a remote security protection measure based on the Internet of Vehicles.
  2. 根据权利要求1所述的盲人安全出行实现方法,其特征在于,所述基于车联网的远程安全保护措施通过云端服务器、车联网模块以及行车系统完成,确定盲人当前出行状态包括识别所述全景图像中的图像元素,将识别的图像元素与预设的出行状态元素比较,确定出行状态。The method for implementing safe travel for blind persons according to claim 1, wherein the remote security protection measure based on the vehicle network is completed by the cloud server, the vehicle networking module, and the driving system, and determining the current travel status of the blind includes identifying the panoramic image. The image element in the image is compared with the preset travel state element to determine the travel status.
  3. 根据权利要求2所述的盲人安全出行实现方法,其特征在于,所述识别的图像元素包括道路斑马线时,识别所述全景图像中出现的车牌信息,并将识别的车牌信息发送至所述云端服务器。The blind person safe travel implementation method according to claim 2, wherein when the identified image element includes a road zebra crossing, identifying license plate information appearing in the panoramic image, and transmitting the recognized license plate information to the cloud server.
  4. 根据权利要求3所述的盲人安全出行实现方法,其特征在于,所述云端服务器根据车牌信息查找与车牌信息对应的车联网模块信息,根据所述车联网模块信息向对应车联网模块发送刹车消息。The method for implementing safe travel for blinds according to claim 3, wherein the cloud server searches for vehicle networking module information corresponding to the license plate information according to the license plate information, and sends a brake message to the corresponding vehicle networking module according to the information of the vehicle networking module. .
  5. 根据权利要求4所述的盲人安全出行实现方法,其特征在于,所述车联网模块与行车系统连接,收到所述刹车消息后,车联网模块获取汽车当前行驶速度,当速度在设定范围时,车联网模块语音提示用户减速;当速度超出设定范围时,车联网模块向行车系统发出刹车请求,所述行车系统控制刹车机构减速。The method for implementing safe travel for blinds according to claim 4, wherein the vehicle networking module is connected to the driving system, and after receiving the braking message, the vehicle networking module obtains the current driving speed of the vehicle, and when the speed is in the setting range When the vehicle networking module voice prompts the user to decelerate; when the speed exceeds the set range, the vehicle networking module issues a braking request to the driving system, and the driving system controls the braking mechanism to decelerate.
  6. 根据权利要求2-5任意一项所述的盲人安全出行实现方法,其特征在于,所述现场提醒装置为闪烁提示灯,所述方法还包括:所述道路斑马线图像元素消失时,关闭所述闪烁提示灯。The method for implementing safe travel for a blind according to any one of claims 2 to 5, wherein the on-site reminding device is a blinking reminder light, the method further comprising: when the road zebra crossing image element disappears, closing the Flashing light.
  7. 根据权利要求6所述的盲人安全出行实现方法,其特征在于,设置雷达 测速传感器以获取盲人周围移动目标的速度参数。The method for implementing safe travel for blinds according to claim 6, wherein the radar is set The speed sensor is used to obtain the speed parameter of the moving target around the blind person.
  8. 一种盲人出行可穿戴设备,包括处理器,其特征在于,还包括:A blind travel wearable device, including a processor, further comprising:
    全景摄像头,用于获取盲人周围全景图像;Panoramic camera for capturing panoramic images around the blind;
    图像处理模块,用于确定盲人当前出行状态,并从所述全景图像中识别出于与出行状态有关的安全信息;An image processing module, configured to determine a current travel status of the blind person, and identify security information related to the travel status from the panoramic image;
    其中,所述处理器根据所述安全信息启动现场提醒装置或者启动基于车联网的远程安全保护措施。The processor starts the on-site reminding device according to the security information or initiates a remote security protection measure based on the Internet of Vehicles.
  9. 根据权利要求8所述的盲人出行可穿戴设备,其特征在于,还包括预设的出行状态元素库,所述图像处理模块用于识别所述全景图像中的图像元素,将识别的图像元素与预设的出行状态元素比较,确定出行状态。The blind travel wearable device according to claim 8, further comprising a preset travel status element library, wherein the image processing module is configured to identify image elements in the panoramic image, and to identify the image elements and The preset travel status elements are compared to determine the travel status.
  10. 根据权利要求9所述的盲人出行可穿戴设备,其特征在于,所述图像处理模块包括车牌识别模块,用于在所述识别的图像元素包括道路斑马线时,识别所述全景图像中出现的车牌信息,并将识别的车牌信息发送至云端服务器。The blind travel wearable device according to claim 9, wherein the image processing module includes a license plate recognition module for identifying a license plate appearing in the panoramic image when the recognized image element includes a road zebra crossing Information and send the identified license plate information to the cloud server.
  11. 根据权利要求7-10任意一项所述的盲人出行可穿戴设备,其特征在于,所述现场提醒装置包括闪烁提示灯和声音模块。The blind travel wearable device according to any one of claims 7 to 10, characterized in that the live reminding device comprises a flashing light and a sound module.
  12. 根据权利要求11所述的盲人出行可穿戴设备,其特征在于,包括雷达测速传感器以获取盲人周围移动目标的速度参数。The blind travel wearable device of claim 11 including a radar speed sensor to obtain a speed parameter of a moving target around the blind.
  13. 一种盲人安全出行实现系统,其特征在于,包括可穿戴设备、云端服务器以及车载系统,该可穿戴设备用于获取盲人周围全景图像,用于确定盲人当前出行状态并从所述全景图像中识别出于与出行状态有关的安全信息,以及用于根据所述安全信息启动现场提醒装置并将所述安全信息发送至云端服务器;A blind person safe travel realization system, comprising: a wearable device, a cloud server, and an in-vehicle system, wherein the wearable device is configured to acquire a panoramic image of a blind person for determining a current travel state of the blind person and identifying from the panoramic image For security information related to the travel status, and for initiating an on-site reminder device based on the security information and transmitting the security information to the cloud server;
    所述云端服务器用于根据所述安全信息向所述车载系统发送控制消息;The cloud server is configured to send a control message to the in-vehicle system according to the security information;
    所述车载系统根据所述控制消息调整车辆的行驶。The onboard system adjusts the travel of the vehicle in accordance with the control message.
  14. 根据权利要求13所述的盲人安全出行实现系统,其特征在于,所述可穿戴设备包括预设的出行状态元素库,所述图像处理模块用于识别所述全景图 像中的图像元素,将识别的图像元素与预设的出行状态元素比较,确定出行状态;所述图像处理模块包括车牌识别模块,用于在所述识别的图像元素包括道路斑马线时,识别所述全景图像中出现的车牌信息,并将识别的车牌信息发送至云端服务器。The system for implementing a blind person safe travel according to claim 13, wherein the wearable device comprises a preset library of travel status elements, and the image processing module is configured to identify the panorama Determining a travel status by comparing the identified image element with a preset travel status element; the image processing module includes a license plate recognition module for identifying the identified image element when the road image includes a road zebra crossing The license plate information appearing in the panoramic image is described, and the recognized license plate information is sent to the cloud server.
  15. 根据权利要求14所述的盲人安全出行实现系统,其特征在于,所述云端服务器根据车牌信息查找与车牌信息对应的车联网模块信息,根据所述车联网模块信息向对应车联网模块发送刹车消息。The blind person safe travel realization system according to claim 14, wherein the cloud server searches for vehicle networking module information corresponding to the license plate information according to the license plate information, and sends a brake message to the corresponding vehicle networking module according to the information of the vehicle networking module. .
  16. 根据权利要求15所述的盲人安全出行实现系统,其特征在于,所述车联网模块与行车系统连接,所述车联网模块包括语音模块,收到所述刹车消息后,车联网模块获取汽车当前行驶速度,当速度在设定范围时,所述语音模块提示用户减速;当速度超出设定范围时,车联网模块向行车系统发出刹车请求,所述行车系统控制刹车机构减速。The system for implementing a blind person safely according to claim 15, wherein the vehicle networking module is connected to a driving system, and the vehicle networking module comprises a voice module. After receiving the braking message, the vehicle networking module acquires a current car. The driving speed, when the speed is within the set range, the voice module prompts the user to decelerate; when the speed exceeds the set range, the vehicle networking module issues a braking request to the driving system, and the driving system controls the braking mechanism to decelerate.
  17. 根据权利要求14-16任意一项所述的盲人安全出行实现系统,其特征在于,所述现场提醒装置为闪烁提示灯,所述道路斑马线图像元素消失时,所述可穿戴设备关闭所述闪烁提示灯。The blind person safe travel realization system according to any one of claims 14-16, wherein the on-site reminding device is a blinking reminder light, and the wearable device turns off the blinking when the road zebra crossing image element disappears Tip light.
  18. 根据权利要求17所述的盲人安全出行实现系统,其特征在于,设置雷达测速传感器以获取盲人周围移动目标的速度参数。 The blind safe travel realization system according to claim 17, wherein a radar speed sensor is provided to acquire a speed parameter of a moving target around the blind person.
PCT/CN2016/112135 2016-12-26 2016-12-26 Method and system for realizing safe trip of blind person, and wearable device WO2018119588A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201680003358.7A CN107072867A (en) 2016-12-26 2016-12-26 A kind of blind safety trip implementation method, system and wearable device
PCT/CN2016/112135 WO2018119588A1 (en) 2016-12-26 2016-12-26 Method and system for realizing safe trip of blind person, and wearable device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/112135 WO2018119588A1 (en) 2016-12-26 2016-12-26 Method and system for realizing safe trip of blind person, and wearable device

Publications (1)

Publication Number Publication Date
WO2018119588A1 true WO2018119588A1 (en) 2018-07-05

Family

ID=59623482

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/112135 WO2018119588A1 (en) 2016-12-26 2016-12-26 Method and system for realizing safe trip of blind person, and wearable device

Country Status (2)

Country Link
CN (1) CN107072867A (en)
WO (1) WO2018119588A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111067767A (en) * 2019-12-30 2020-04-28 西安Tcl软件开发有限公司 Walking assistance device, control method thereof, control device thereof, and readable storage medium
CN113428176A (en) * 2021-06-25 2021-09-24 阿波罗智联(北京)科技有限公司 Method, device, equipment and storage medium for adjusting unmanned vehicle driving strategy
CN113813146A (en) * 2021-09-30 2021-12-21 紫清智行科技(北京)有限公司 Outdoor blind guiding method and system based on combination of navigation and blind track tracking
CN113885704A (en) * 2021-09-30 2022-01-04 紫清智行科技(北京)有限公司 Man-machine interaction method and system for blind guiding vehicle
CN114287830A (en) * 2021-12-13 2022-04-08 珠海一微半导体股份有限公司 Cleaning robot system for blind people and control method thereof
CN114973639A (en) * 2022-07-27 2022-08-30 广州华途信息科技有限公司 Visual barrier person street crossing sound prompting method and system for pedestrian crossing signal lamp
CN115471997A (en) * 2022-09-03 2022-12-13 湖南捷力泰科技有限公司 Opto-acoustic conversion method, system, equipment and storage medium for blind people
CN115472039A (en) * 2021-06-10 2022-12-13 上海博泰悦臻网络技术服务有限公司 Information processing method and related product

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107802472A (en) * 2017-11-22 2018-03-16 佛山市海科云筹信息技术有限公司 A kind of blind man's stick and its method with crossing alarm function
CN107802469A (en) * 2017-11-22 2018-03-16 佛山市海科云筹信息技术有限公司 A kind of intelligent blind man's stick and method
CN107669453A (en) * 2017-11-22 2018-02-09 佛山市海科云筹信息技术有限公司 A kind of blind man's stick
CN107661196A (en) * 2017-11-22 2018-02-06 佛山市海科云筹信息技术有限公司 A kind of blind man's stick and its method with environment self-adaption alarm function
CN108225433B (en) * 2018-01-19 2020-08-04 张曦月 Watch for road crossing indication
CN108417025A (en) * 2018-03-10 2018-08-17 张定宇 A kind of blind person crossing is passed through guiding system, device and its working method
CN108848602A (en) * 2018-08-30 2018-11-20 上海与德科技有限公司 A kind of lamp light control method and device
CN110555987A (en) * 2019-08-01 2019-12-10 宝能汽车有限公司 wisdom wearing equipment
CN113058233A (en) * 2020-12-06 2021-07-02 泰州可以信息科技有限公司 Landing area grading management system and method
CN113299091A (en) * 2021-04-28 2021-08-24 深圳市文业照明实业有限公司 Intelligent traffic road surface illumination warning method and system
CN113908019B (en) * 2021-09-08 2022-12-27 中国科学院深圳先进技术研究院 Walking aid following method and system based on walking aid and terminal equipment
CN113768760B (en) * 2021-09-08 2022-12-20 中国科学院深圳先进技术研究院 Control method and system of walking aid and driving device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103735393A (en) * 2013-12-27 2014-04-23 朱寰 Human-computer interaction intelligent blind-guide instrument
CN104346924A (en) * 2014-10-17 2015-02-11 王海鹏 Intelligent road traffic guidance system for blind persons
CN104739622A (en) * 2015-02-04 2015-07-01 覃泳睿 Novel wearable blind guiding equipment and working method thereof
CN105225474A (en) * 2015-08-19 2016-01-06 奇瑞汽车股份有限公司 Based on the traffic collision early warning system of intelligent wearable device
CN105640748A (en) * 2016-03-16 2016-06-08 宁波市江东精诚自动化设备有限公司 Vibration blind-guiding clothing
CN105741611A (en) * 2016-03-17 2016-07-06 东莞市智捷自动化设备有限公司 Vehicle networking safety early warning system and method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105291984A (en) * 2015-11-13 2016-02-03 中国石油大学(华东) Pedestrian and vehicle detecting method and system based on multi-vehicle cooperation

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103735393A (en) * 2013-12-27 2014-04-23 朱寰 Human-computer interaction intelligent blind-guide instrument
CN104346924A (en) * 2014-10-17 2015-02-11 王海鹏 Intelligent road traffic guidance system for blind persons
CN104739622A (en) * 2015-02-04 2015-07-01 覃泳睿 Novel wearable blind guiding equipment and working method thereof
CN105225474A (en) * 2015-08-19 2016-01-06 奇瑞汽车股份有限公司 Based on the traffic collision early warning system of intelligent wearable device
CN105640748A (en) * 2016-03-16 2016-06-08 宁波市江东精诚自动化设备有限公司 Vibration blind-guiding clothing
CN105741611A (en) * 2016-03-17 2016-07-06 东莞市智捷自动化设备有限公司 Vehicle networking safety early warning system and method

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111067767A (en) * 2019-12-30 2020-04-28 西安Tcl软件开发有限公司 Walking assistance device, control method thereof, control device thereof, and readable storage medium
CN111067767B (en) * 2019-12-30 2022-12-23 西安Tcl软件开发有限公司 Walking assistance device, control method thereof, control device thereof, and readable storage medium
CN115472039A (en) * 2021-06-10 2022-12-13 上海博泰悦臻网络技术服务有限公司 Information processing method and related product
CN115472039B (en) * 2021-06-10 2024-03-01 上海博泰悦臻网络技术服务有限公司 Information processing method and related product
CN113428176A (en) * 2021-06-25 2021-09-24 阿波罗智联(北京)科技有限公司 Method, device, equipment and storage medium for adjusting unmanned vehicle driving strategy
CN113428176B (en) * 2021-06-25 2023-11-14 阿波罗智联(北京)科技有限公司 Unmanned vehicle driving strategy adjustment method, device, equipment and storage medium
CN113885704A (en) * 2021-09-30 2022-01-04 紫清智行科技(北京)有限公司 Man-machine interaction method and system for blind guiding vehicle
CN113885704B (en) * 2021-09-30 2022-04-05 紫清智行科技(北京)有限公司 Man-machine interaction method and system for blind guiding vehicle
CN113813146A (en) * 2021-09-30 2021-12-21 紫清智行科技(北京)有限公司 Outdoor blind guiding method and system based on combination of navigation and blind track tracking
CN114287830A (en) * 2021-12-13 2022-04-08 珠海一微半导体股份有限公司 Cleaning robot system for blind people and control method thereof
CN114973639B (en) * 2022-07-27 2022-11-15 广州华途信息科技有限公司 Visual barrier person street crossing sound prompting method and system for pedestrian crossing signal lamp
CN114973639A (en) * 2022-07-27 2022-08-30 广州华途信息科技有限公司 Visual barrier person street crossing sound prompting method and system for pedestrian crossing signal lamp
CN115471997A (en) * 2022-09-03 2022-12-13 湖南捷力泰科技有限公司 Opto-acoustic conversion method, system, equipment and storage medium for blind people
CN115471997B (en) * 2022-09-03 2024-02-06 湖南捷力泰科技有限公司 Photoacoustic conversion method, system, equipment and storage medium for blind people

Also Published As

Publication number Publication date
CN107072867A (en) 2017-08-18

Similar Documents

Publication Publication Date Title
WO2018119588A1 (en) Method and system for realizing safe trip of blind person, and wearable device
JP6815047B2 (en) Autonomous driving control system and vehicle
US11117596B2 (en) Intelligent driving control
KR102440246B1 (en) Early boarding of passengers in autonomous vehicles
US11001196B1 (en) Systems and methods for communicating a machine intent
US10606257B2 (en) Automatic parking system and automatic parking method
US20180253977A1 (en) Vehicle operation assistance
US11119492B2 (en) Automatically responding to emergency service vehicles by an autonomous vehicle
US10850739B2 (en) Automatic lane change with lane-biased strategy
US10521680B2 (en) Detecting foliage using range data
US11370416B2 (en) Vehicle control system, vehicle control method, and storage medium
KR102183189B1 (en) Intra-vehicular mobile device management
WO2017128537A1 (en) Method for processing early warning of vehicle, server and system
WO2018068385A1 (en) Control method and terminal for safe vehicle driving
US20190043363A1 (en) Vehicle external notification device
US20230331259A1 (en) Vehicle summoning method, intelligent vehicle, and device
EP3342681A1 (en) Automatic parking system and automatic parking method
CN111319616A (en) Vehicle control method and device based on driver state and vehicle
CN113119982A (en) Operation state recognition and processing method, device, equipment, medium and program product
TWI802975B (en) Autonomous driving vehicle parking detection
JP2018127066A (en) Parking support device
CN108068801A (en) Vehicle flat tire processing method, device, system, detection device and electronic equipment
US20220114815A1 (en) Moving body collision avoidance device, collision avoidance method and electronic device
CN113561982A (en) Driver coma processing method and device and readable storage medium
CN112120899A (en) Intelligent walking stick for blind based on computer vision

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16925640

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 17/10/2019)

122 Ep: pct application non-entry in european phase

Ref document number: 16925640

Country of ref document: EP

Kind code of ref document: A1