CN109109744B - System for displaying missing image and arrangement method - Google Patents

System for displaying missing image and arrangement method Download PDF

Info

Publication number
CN109109744B
CN109109744B CN201810839205.7A CN201810839205A CN109109744B CN 109109744 B CN109109744 B CN 109109744B CN 201810839205 A CN201810839205 A CN 201810839205A CN 109109744 B CN109109744 B CN 109109744B
Authority
CN
China
Prior art keywords
observer
base station
data
base stations
displaying
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201810839205.7A
Other languages
Chinese (zh)
Other versions
CN109109744A (en
Inventor
刘世交
白国振
李帅
祁涛
李兴怡
闻章
彭长武
黄子曙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Shanghai for Science and Technology
Original Assignee
University of Shanghai for Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Shanghai for Science and Technology filed Critical University of Shanghai for Science and Technology
Priority to CN201810839205.7A priority Critical patent/CN109109744B/en
Publication of CN109109744A publication Critical patent/CN109109744A/en
Application granted granted Critical
Publication of CN109109744B publication Critical patent/CN109109744B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/105Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using multiple cameras
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/20Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
    • B60R2300/202Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used displaying a blind spot scene on the vehicle part responsible for the blind spot
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/802Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying vehicle exterior blind spot views
    • B60R2300/8026Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying vehicle exterior blind spot views in addition to a rear-view mirror system

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Mechanical Engineering (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The invention provides a system for displaying a missing image and an arrangement method thereof, wherein the system for displaying the missing image comprises a collecting unit, a displacement measuring unit, an analyzing unit and a display unit, wherein the collecting unit comprises two high-definition 1080P wide-angle cameras, the displacement measuring unit comprises an angular displacement sensor, 4 first base stations and a second base station, the analyzing unit is a vehicle-mounted CPU (Central processing Unit), and the display unit is a flexible screen or a common display screen. The system for displaying the missing images provided by the invention can synchronously display the missing images which are missing due to the blockage of the A column of the automobile in real time, the pictures of the missing images change along with the movement change of the head of the driver, and the completeness of the pictures in the visual field of the driver can be always kept.

Description

System for displaying missing image and arrangement method
Technical Field
The invention particularly relates to a system and an arrangement method for displaying a missing image.
Background
In daily work and life, an obstacle is often in front of an observer, and the observer cannot see a blocked image picture due to the existence of the obstacle, which brings much inconvenience to life and work, even brings danger.
The automobile A column is an important structure of an automobile, is a safety guarantee and cannot be removed, but the existence of the automobile A column enables a driver to easily appear a visual dead angle in the driving process, the visual incomplete result is caused, and traffic accidents are often caused. The problem of dead angles of an A column of the automobile is solved at the present stage, the rigidity of the A column is reduced, or the dead angles are displayed on a central control screen, so that great inconvenience and safety are caused to driving. The driving safety is only within milliseconds, so the problem needs to be solved urgently.
For an automobile A column, the following technologies are available:
1. the triangular window is opened, the strength of the rearview mirror is sacrificed, and the rigidity of the A column cannot be ensured;
2. the 360-degree panoramic camera disclosed in patent publication No. CN 107776492A is that cameras are installed around the automobile, and the surrounding environment is displayed at the central control screen of the automobile. The automobile driving display screen has the disadvantages that when a driver drives the automobile, the driver needs to look at the display screen with a low head in a distracted way, great inconvenience is caused, and the risk of driving is also increased.
Disclosure of Invention
The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a system for displaying a missing image that is missing due to a block of an a-pillar of an automobile.
The present invention provides a system for displaying a missing image, for displaying a real-time synchronized missing image missing in the field of view of an observer due to obstruction by an obstacle, having the features comprising: the acquisition unit is used for acquiring real-time image data around the barrier; the displacement measuring unit comprises a displacement measurer, a plurality of first base stations and a second base station, wherein the displacement measurer is worn on the head of an observer and used for synchronously reflecting the head displacement of the observer in real time, the first base stations are arranged around the observer, the second base stations are arranged nearby the observer, the displacement measurer is respectively in communication connection with the first base stations and the second base stations, and the first base stations are in communication connection with the second base stations; the analysis unit is arranged near the observer and is respectively in communication connection with the acquisition unit, the displacement measurer and the first base station; and a display unit, which is arranged on the surface of the barrier close to the observer side and is in communication connection with the analysis unit, wherein the acquisition unit, the displacement measurement unit, the analysis unit, the display unit, the barrier and the observer are all on the same moving object, when the system is arranged, the second base station sends a first pulse signal to each first base station, the analysis unit respectively calculates and records the time required by each first base station to receive the first pulse signal, the time is duration data, the displacement measurer acquires and regularly sends visual angle displacement data of the head of the observer to the analysis unit, the displacement measurer also regularly and synchronously sends a second pulse signal to each first base station and each second base station, the first base station acquires the time data when the second pulse signal reaches the first base station, the time data is first data, and each first base station acquires respective first data, after the first base station and the second base station receive the second pulse signal, the second base station synchronously sends a third pulse signal to each first base station, the third pulse signal is used for synchronizing the starting time of each first base station in real time, the first base station collects the time data of the third pulse signal reaching the first base station, the time data is second data, each first base station collects respective second data, the first base station sends the collected first data and the collected second data to the analysis unit, the analysis unit receives the real-time image data, the view angle displacement data and the first data and the second data of each first base station, the data of the missing image is obtained after the comprehensive processing and analysis are carried out by combining each time length data of each first base station, and the missing image data is displayed through the display unit synchronously in real time.
The system for displaying a missing image provided by the present invention may further have the following features: in this case, the screen of the missing image changes as the head of the observer moves.
The system for displaying a missing image provided by the present invention may further have the following features: wherein, the acquisition unit includes a plurality of camera devices of setting on the barrier or on the object.
The system for displaying a missing image provided by the present invention may further have the following features: the number of the first base stations is at least three, each first base station is distributed around an observer, the distance from the observer is within 50m, and the distance from the second base station to the observer is within 50 m.
The system for displaying a missing image provided by the present invention may further have the following features: the displacement measurer is an angular displacement sensor with a transmitting chip.
The system for displaying a missing image provided by the present invention may further have the following features: wherein, the display unit is a flexible screen or a common display screen.
The system for displaying a missing image provided by the present invention may further have the following features: wherein the shape and size of the display unit are consistent with those of the barrier, and the whole blocking part of the barrier for blocking the sight of the observer is covered.
The system for displaying a missing image provided by the present invention may further have the following features: wherein the analysis unit has a processor.
The present invention also provides the arrangement method of the system for displaying a missing image, which has the following characteristics: placing a camera device on an obstacle or an object; secondly, arranging a plurality of first base stations around an observer; step three, placing a second base station around the position within 50m from the observer; step four, placing the analysis unit around the observer; step five, arranging the flexible screen on the whole surface of the barrier close to one side of an observer; and step six, wearing the displacement measuring device on the head of the observer.
Action and Effect of the invention
According to the system for displaying the missing images, which is provided by the invention, because the design is reasonable, the system for displaying the missing images can synchronously display the missing images which are missing due to the blockage of the A column of the automobile in real time, a driver can always see a complete picture, and the danger or traffic accidents caused by the existence of the dead angle of the A column of the automobile are avoided to the greatest extent.
Drawings
FIG. 1 is a schematic diagram of the arrangement of the unit devices in a system for displaying missing images provided by the present invention; and
fig. 2 is a schematic diagram of the operation between units in a system for displaying a missing image according to the present invention.
Detailed Description
In order to make the technical means, the creation features, the achievement objects and the effects of the present invention easy to understand, the following embodiments specifically describe a system for displaying a missing image according to the present invention with reference to the accompanying drawings.
The invention provides a system for displaying a missing image, which comprises an acquisition unit, a displacement measurement unit, an analysis unit and a display unit.
The acquisition unit is two 1080P wide-angle cameras of high definition.
The displacement measuring unit comprises an angular displacement sensor with a transmitting chip, 4 first base stations and a second base station.
The analysis unit is an on-board CPU processor with a reinforced chip.
The display unit is a flexible screen.
Fig. 1 is a schematic diagram of arrangement of unit devices in a system for displaying a missing image according to the present invention.
As shown in fig. 1, the method of arranging the system for displaying the missing image is as follows:
step one, two cameras are respectively placed on one side of the front end of a vehicle head, namely the position marked with 10 in the figure, and the other side of the front end of the vehicle head, namely the position marked with 20 in the figure;
step two, respectively placing 4 first base stations on the left side of the locomotive, namely the position marked with 30 in the figure; the right side of the vehicle head, namely the position marked with 40 in the figure; the left side of the tail, i.e., the position indicated at 50 in the figure; and the right side of the tail, the position indicated at 60 in the figure;
step three, placing the second base station at the top end of the vehicle, namely the position marked with 70 in the figure;
step four, the CPU processor is a vehicle-mounted CPU processor position with a reinforced chip and is positioned in the automobile room;
step five, covering the whole surface of one automobile A column 1 on the left side of the automobile chamber on one side of the automobile chamber and the whole surface of one automobile A column 2 on the right side of the automobile chamber on one side of the automobile chamber by a flexible screen;
and step six, wearing the angular displacement sensor with the transmitting chip on the head of the driver.
In addition, the angular displacement sensor and the first base station, the angular displacement sensor and the second base station and the first base station and the second base station are connected through wireless communication, and the CPU is respectively connected with the two cameras, the angular displacement sensor, the flexible screen and the first base station through wireless communication.
After the arrangement is completed, the driver sits in the cab positioned at the left front in the figure, and starts the automobile to run on the road.
Fig. 2 is a schematic diagram of the operation between units in a system for displaying a missing image according to the present invention.
As shown in fig. 1 and 2, when the driver drives the vehicle on the road, first, the second base station sends the first pulse signal to each first base station, and the CPU respectively calculates and records the time required for each first base station to receive the first pulse signal, where the time is duration data.
And secondly, the two cameras synchronously acquire real-time image data around the automobile in real time and synchronously transmit the real-time image data to the CPU.
And thirdly, the angular displacement sensor with the transmitting chip is worn behind the head of the driver and can synchronously reflect the displacement of the head of the driver in real time, the angular displacement sensor synchronously collects the visual angle displacement data of the head of the driver in real time, and the transmitting chip synchronously sends the visual angle displacement data to the CPU processor in real time. The transmitting chip also synchronously transmits second pulse signals to the 4 first base stations and the second base station, the first base stations acquire time data when the second pulse signals reach the first base stations, the time data are first data, and the 4 first base stations respectively acquire respective first data.
And thirdly, after the 4 first base stations and the second base station receive the second pulse signal, the second base station respectively synchronously sends a third pulse signal to the 4 first base stations, and the third pulse signal is used for synchronizing the starting time of the 4 first base stations in real time.
And thirdly, the first base station acquires time data when the third pulse signal reaches the first base station, the time data is second data, 4 first base stations acquire respective second data, and the 4 first base stations transmit the respective acquired first data and second data to the CPU processor.
And finally, the CPU receives the real-time image data and the visual angle displacement data of the two cameras and the respective first data and second data of the 4 first base stations, performs comprehensive processing and analysis by combining each duration data of each first base station to obtain missing image data, and displays the missing image by synchronously displaying the missing image data through the flexible screen in real time.
The missing image picture synchronously displays the missing part of the picture due to the blockage of the two A columns in real time, and the missing image picture changes along with the change of the head movement of the driver, so that the completeness of the picture in the visual field of the driver can be always kept.
Effects and effects of the embodiments
According to the system for displaying the missing image, which is provided by the embodiment, because the design is reasonable, the system for displaying the missing image can synchronously display the missing image which is missed due to the blocking of the A column of the automobile in real time, a driver can always see a complete picture, and the danger or traffic accidents caused by the existence of the dead angle of the A column of the automobile are avoided to the greatest extent.
The above embodiments are preferred examples of the present invention, and are not intended to limit the scope of the present invention.

Claims (7)

1. A system for displaying a missing image for displaying a real-time synchronized missing image missing from an obstruction in a field of view of an observer, comprising:
the acquisition unit is used for acquiring real-time image data around the obstacle;
the displacement measuring unit comprises a displacement measurer, a plurality of first base stations and a second base station, wherein the displacement measurer is worn on the head of the observer and used for synchronously reflecting the head displacement of the observer in real time, the first base stations are arranged around the observer, the second base stations are arranged nearby the observer, the displacement measurer is respectively in communication connection with the first base stations and the second base stations, and the first base stations are in communication connection with the second base stations;
the analysis unit is arranged near the observer and is respectively in communication connection with the acquisition unit, the displacement measurer and the first base station; and
a display unit arranged on the surface of the barrier close to the observer side and connected with the analysis unit in communication,
wherein the acquisition unit, the displacement measurement unit, the analysis unit, the display unit, the obstacle and the observer are all on the same moving object,
after the system is arranged, the second base station sends first pulse signals to each first base station, the analysis unit respectively calculates and records the time required by each first base station for receiving the first pulse signals, the time is duration data,
the displacement measurer collects and periodically sends the visual angle displacement data of the head of the observer to the analysis unit,
the displacement measurer also sends a second pulse signal to each of the first base station and the second base station in a timing synchronization manner,
the first base station collects the time data when the second pulse signal reaches the first base station, the time data is first data,
each of the first base stations collects respective first data,
after all the first base stations and the second base stations receive the second pulse signals, the second base station synchronously sends third pulse signals to the first base stations, and the third pulse signals are used for synchronizing the starting time of the first base stations in real time,
the first base station acquires time data when the third pulse signal reaches the first base station, wherein the time data is second data,
each of the first base stations collects respective second data,
the first base station transmits the collected first data and the second data to the analysis unit,
the analysis unit receives the real-time image data, the view displacement data, the first data and the second data of each first base station, and performs comprehensive processing and analysis by combining each duration data of each first base station to obtain the missing image data,
the missing image data is synchronously displayed by the display unit in real time,
the acquisition unit comprises a plurality of camera devices arranged on the barrier or the object,
the display unit is a flexible screen or a common display screen.
2. The system for displaying a missing image as claimed in claim 1, wherein:
wherein the frame of the missing image changes as the movement of the head of the observer changes.
3. The system for displaying a missing image as claimed in claim 1, wherein:
wherein the number of the first base stations is at least three, each of the first base stations is distributed around the observer, the distance from the observer is within 50m, and the distance from the second base station to the observer is within 50 m.
4. The system for displaying a missing image as claimed in claim 1, wherein:
wherein, the displacement measurer is an angular displacement sensor with a transmitting chip.
5. The system for displaying a missing image as claimed in claim 1, wherein:
wherein the shape and size of the display unit are identical to those of the obstacle, covering the entire blocking portion of the obstacle that blocks the view of the observer.
6. The system for displaying a missing image as claimed in claim 1, wherein:
wherein the analysis unit has a processor.
7. A method of arranging the system for displaying a missing image of any of claims 1-6, comprising:
placing the camera device on the obstacle or the object;
placing a plurality of first base stations around the observer;
step three, the second base station is placed at the periphery within 50m from the observer;
step four, placing an analysis unit around the observer;
step five, arranging the flexible screen on the whole surface of the barrier close to one side of the observer;
and step six, wearing the displacement measuring device on the head of the observer.
CN201810839205.7A 2018-07-27 2018-07-27 System for displaying missing image and arrangement method Expired - Fee Related CN109109744B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810839205.7A CN109109744B (en) 2018-07-27 2018-07-27 System for displaying missing image and arrangement method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810839205.7A CN109109744B (en) 2018-07-27 2018-07-27 System for displaying missing image and arrangement method

Publications (2)

Publication Number Publication Date
CN109109744A CN109109744A (en) 2019-01-01
CN109109744B true CN109109744B (en) 2020-12-01

Family

ID=64863350

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810839205.7A Expired - Fee Related CN109109744B (en) 2018-07-27 2018-07-27 System for displaying missing image and arrangement method

Country Status (1)

Country Link
CN (1) CN109109744B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103204105A (en) * 2013-03-23 2013-07-17 苏州佳世达光电有限公司 Head-up display device and method for displaying images on same
CN106143307A (en) * 2016-07-11 2016-11-23 京东方科技集团股份有限公司 A kind of drive assist system and vehicle
CN106799994A (en) * 2017-01-13 2017-06-06 曾令鹏 A kind of method and apparatus for eliminating motor vehicle operator vision dead zone
CN108235427A (en) * 2018-02-07 2018-06-29 南京邮电大学 A kind of method for measuring Tof and Toda

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201385620Y (en) * 2009-03-02 2010-01-20 徐胜 Cab visual disturbance eliminating device
US9129430B2 (en) * 2013-06-25 2015-09-08 Microsoft Technology Licensing, Llc Indicating out-of-view augmented reality images
CN103358996B (en) * 2013-08-13 2015-04-29 吉林大学 Automobile A pillar perspective vehicle-mounted display device
US9428056B2 (en) * 2014-03-11 2016-08-30 Textron Innovations, Inc. Adjustable synthetic vision
US10445573B2 (en) * 2014-06-27 2019-10-15 Fove, Inc. Gaze detection device
KR102275778B1 (en) * 2014-12-04 2021-07-09 삼성디스플레이 주식회사 Head mounted display device
CN204641550U (en) * 2015-03-31 2015-09-16 上海通用汽车有限公司 Vehicular visual blind area display system and vehicle
KR101822894B1 (en) * 2016-04-07 2018-01-29 엘지전자 주식회사 Driver assistance apparatus and Vehicle
CN105857181A (en) * 2016-05-12 2016-08-17 镇江市丹徒区硕源材料科技有限公司 Device system for eliminating pillar A dead zones

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103204105A (en) * 2013-03-23 2013-07-17 苏州佳世达光电有限公司 Head-up display device and method for displaying images on same
CN106143307A (en) * 2016-07-11 2016-11-23 京东方科技集团股份有限公司 A kind of drive assist system and vehicle
CN106799994A (en) * 2017-01-13 2017-06-06 曾令鹏 A kind of method and apparatus for eliminating motor vehicle operator vision dead zone
CN108235427A (en) * 2018-02-07 2018-06-29 南京邮电大学 A kind of method for measuring Tof and Toda

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
A new method for wireless synchronization and TDOA error reduction in UWB positioning system;Vitomir Djaja-Josko et al;《2016 21st International Conference on Microwave, Radar and Wireless Communications (MIKON)》;20160616;全文 *
基于自适应卡尔曼滤波的超宽带室内定位系统;童基均等;《测试技术学报》;20180514;全文 *

Also Published As

Publication number Publication date
CN109109744A (en) 2019-01-01

Similar Documents

Publication Publication Date Title
US20190061622A1 (en) System and process for viewing in blind spots
US6396535B1 (en) Situation awareness system
CN103946066B (en) Vehicle periphery monitoring apparatus and vehicle periphery monitoring method
EP1961613B1 (en) Driving support method and driving support device
US20130021453A1 (en) Autostereoscopic rear-view display system for vehicles
KR20200006556A (en) Cross vision for autonomous vehicle systems
JP6381981B2 (en) Track space obstacle detection system
JP2009101718A (en) Image display device and image display method
CN102729902A (en) Embedded panoramic display device and method served for automobile safe driving
CN110228414B (en) Vehicle-mounted camera mounting method and device
CN108995591A (en) Vehicle panoramic has an X-rayed display methods, system and the vehicle with it
CN110509850A (en) A kind of hyperbolicity electronics rearview mirror system
CN115727780A (en) Tunnel comprehensive inspection robot system
CN113147597A (en) Vehicle electronic rearview mirror display system and method and vehicle
CN109109744B (en) System for displaying missing image and arrangement method
CN109109745B (en) System for displaying missing image
JP2017504516A (en) Apparatus and method for visually recognizing a background by an electronic display for a vehicle
CN113401058A (en) Real-time display method and system for automobile A column blind area based on three-dimensional coordinates of human eyes
CN114902309A (en) Driving support device, driving support method, and program
CN113212307B (en) Electronic rearview mirror with 360-degree environment monitoring function
CN110450727A (en) A kind of transparence display system
JP2000259818A (en) Condition information providing device and method therefor
CN210075404U (en) Panoramic camera system
WO2013125301A1 (en) Surveillance system
WO2002091746A2 (en) Image processing device, image processing method and vehicle monitor system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20201201

CF01 Termination of patent right due to non-payment of annual fee