CN108965644B - System for displaying missing image and arrangement method - Google Patents

System for displaying missing image and arrangement method Download PDF

Info

Publication number
CN108965644B
CN108965644B CN201810839367.0A CN201810839367A CN108965644B CN 108965644 B CN108965644 B CN 108965644B CN 201810839367 A CN201810839367 A CN 201810839367A CN 108965644 B CN108965644 B CN 108965644B
Authority
CN
China
Prior art keywords
observer
base station
data
base stations
missing image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810839367.0A
Other languages
Chinese (zh)
Other versions
CN108965644A (en
Inventor
刘世交
白国振
李帅
祁涛
李兴怡
闻章
彭长武
黄子曙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhangzhou Longwen Shipeng Information Technology Co ltd
Original Assignee
University of Shanghai for Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Shanghai for Science and Technology filed Critical University of Shanghai for Science and Technology
Priority to CN201810839367.0A priority Critical patent/CN108965644B/en
Publication of CN108965644A publication Critical patent/CN108965644A/en
Application granted granted Critical
Publication of CN108965644B publication Critical patent/CN108965644B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/04Synchronising
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/64Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W56/00Synchronisation arrangements
    • H04W56/001Synchronization between nodes

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The invention provides a system for displaying a missing image and an arrangement method thereof, wherein the system for displaying the missing image comprises a collecting unit, a displacement measuring unit, an analyzing unit and a display unit, wherein the collecting unit is 4 high-definition 1080P wide-angle cameras, the displacement measuring unit is an angular displacement sensor with a transmitting chip, 4 first base stations and a second base station, the analyzing unit is a computer, and the display unit is a flexible screen or a common display screen. The system for displaying the missing image provided by the invention can synchronously display the missing image which is missing due to the blocking of the middle barrier of the window in real time, the picture of the missing image changes along with the movement change of the head of an observer, and the integrity of the picture in the visual field of the observer can be always kept.

Description

System for displaying missing image and arrangement method
Technical Field
The invention relates to a system and an arrangement method for displaying a missing image.
Background
In daily work and life, an obstacle is often in front of an observer, and the observer cannot see a blocked image picture due to the existence of the obstacle, which brings much inconvenience to life and work.
The window generally has a middle partition, when an indoor observer looks at an outside scene through the window, the entire outside image cannot be seen due to the middle partition, and the presence of the middle partition blocks a part of the line of sight of the observer, that is, the observer cannot see the part of the missing image which is missing due to the blocking of the middle partition.
Disclosure of Invention
The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a system for displaying a missing image that is missing due to a middle barrier of a window.
The present invention provides a system for displaying a missing image, for displaying a real-time synchronized missing image missing in the field of view of an observer due to obstruction by an obstacle, having the features comprising: the acquisition unit is used for acquiring real-time image data around the barrier; the displacement measuring unit comprises a displacement measurer, a plurality of first base stations and a second base station, wherein the displacement measurer is worn on the head of an observer and used for synchronously reflecting the head displacement of the observer in real time, the first base stations are arranged around the observer, the second base stations are arranged nearby the observer, the displacement measurer is respectively in communication connection with the first base stations and the second base stations, and the first base stations are in communication connection with the second base stations; the analysis unit is arranged near the observer and is respectively in communication connection with the acquisition unit, the displacement measurer and the first base station; and a display unit, which is arranged on the surface of the barrier close to the observer side and is in communication connection with the analysis unit, wherein the acquisition unit, the displacement measurement unit, the analysis unit, the display unit, the barrier and the observer are all on a static object, when the system is arranged, the second base station sends a first pulse signal to each first base station, the analysis unit respectively calculates and records the time required by each first base station to receive the first pulse signal, the time is duration data, the displacement measurer acquires and regularly sends visual angle displacement data of the head of the observer to the analysis unit, the displacement measurer also regularly and synchronously sends a second pulse signal to each first base station and each second base station, the first base station acquires the time data when the second pulse signal reaches the first base station, the time data is first data, and each first base station acquires respective first data, after the first base station and the second base station receive the second pulse signal, the second base station synchronously sends a third pulse signal to each first base station, the third pulse signal is used for synchronizing the starting time of each first base station in real time, the first base station collects the time data of the third pulse signal reaching the first base station, the time data is second data, each first base station collects respective second data, the first base station sends the collected first data and the collected second data to the analysis unit, the analysis unit receives the real-time image data, the view angle displacement data and the first data and the second data of each first base station, the data of the missing image is obtained after the comprehensive processing and analysis are carried out by combining each time length data of each first base station, and the missing image data is displayed through the display unit synchronously in real time.
The system for displaying a missing image provided by the present invention may further have the following features: in this case, the screen of the missing image changes as the head of the observer moves.
The system for displaying a missing image provided by the present invention may further have the following features: wherein, the acquisition unit includes a plurality of camera devices of setting on the barrier or on the object.
The system for displaying a missing image provided by the present invention may further have the following features: the number of the first base stations is at least three, each first base station is distributed around an observer, the distance from the observer is within 50m, and the distance from the second base station to the observer is within 50 m.
The system for displaying a missing image provided by the present invention may further have the following features: the displacement measurer is an angular displacement sensor with a transmitting chip.
The system for displaying a missing image provided by the present invention may further have the following features: wherein, the display unit is a flexible screen or a common display screen.
The system for displaying a missing image provided by the present invention may further have the following features: wherein the shape and size of the display unit are consistent with those of the barrier, and the whole blocking part of the barrier for blocking the sight of the observer is covered.
The system for displaying a missing image provided by the present invention may further have the following features: wherein the analysis unit has a processor.
The present invention also provides the arrangement method of the system for displaying a missing image, which has the following characteristics: placing a camera device on an obstacle or an object; secondly, arranging a plurality of first base stations around an observer; step three, placing a second base station around the position within 50m from the observer; step four, placing the analysis unit around the observer; step five, arranging the flexible screen on the whole surface of the barrier close to one side of an observer; and step six, wearing the displacement measuring device on the head of the observer.
Action and Effect of the invention
According to the system for displaying the missing image of the present invention, the design is reasonable, so the system for displaying the missing image of the present invention can synchronously display the missing image which is missing due to the blocking of the spacer in the window in real time, and the observer can always synchronously see the complete image picture outside the window in real time.
Drawings
FIG. 1 is a schematic front view of a camera device disposed in a window with a center sill in a system for displaying a missing image according to the present invention;
FIG. 2 is a top view of a system for displaying a missing image according to the present invention with the units arranged in a room; and
fig. 3 is a schematic diagram of the operation between units in a system for displaying a missing image according to the present invention.
Detailed Description
In order to make the technical means, the creation features, the achievement objects and the effects of the present invention easy to understand, the following embodiments specifically describe a system for displaying a missing image according to the present invention with reference to the accompanying drawings.
EXAMPLE I
The invention provides a system for displaying a missing image, which comprises an acquisition unit, a displacement measurement unit, an analysis unit and a display unit.
The acquisition unit is a 1080P wide-angle camera of 4 high-resolutions.
The displacement measuring unit comprises an angular displacement sensor with a transmitting chip, 4 first base stations and a second base station.
The analysis unit is a computer.
The display unit is a flexible screen.
Fig. 1 is a schematic front view of a camera arrangement in a window with a center sill in a system for displaying a missing image according to the present invention.
Fig. 2 is a top view of the arrangement of units in a room in a system for displaying a missing image according to the present invention.
As shown in fig. 2, 6 and 7 are walls, the first base station, the second base station, the computer and the observer are all located indoors, and the distances between the first base station, the second base station and the computer are within 20 meters from the observer.
As shown in fig. 1 and 2, the method of arranging the system for displaying the missing image is as follows:
step one, 4 cameras are respectively placed in the middle of each frame on the window 80, namely, the positions of 1, 2, 3 and 4 are respectively marked in fig. 1.
Step two, respectively placing 4 first base stations at the left front part of the indoor window 80, namely the position marked with 10 in the figure; the right front, i.e. the position indicated 20 in the figure; the left rear, i.e. the position indicated by 30 in the figure; and the right rear, i.e. the position indicated by 40 in the figure.
And step three, placing the second base station at the rear of the indoor window 80, namely at the position indicated by 50 in the figure.
Step four, the computer is placed next to the second base station, i.e. at the position indicated by 60 in the figure.
And step five, pasting the flexible screen on the whole surface of the indoor side of the middle partition 5.
And step six, wearing the angular displacement sensor with the transmitting chip on the head of an observer.
In addition, the angular displacement sensor is connected with the first base station and the second base station through wireless communication, and the computer is respectively connected with the two cameras, the angular displacement sensor, the flexible screen and the first base station through wireless communication.
After deployment, the viewer stands in front of the window 80, at the position indicated at 70 in the figure, to view the image outside the window 80.
Fig. 3 is a schematic diagram of the operation between units in a system for displaying a missing image according to the present invention.
As shown in fig. 1, 2 and 3, when an observer stands in front of the window 80, i.e. at the position indicated by 70 in the figure, and observes the image outside the window 80, first, the second base station transmits the first pulse signal to each first base station, and the computer calculates and records the time required for each first base station to receive the first pulse signal, wherein the time is the time duration data.
Secondly, the 4 cameras synchronously acquire real-time image data around the window 80 in real time and synchronously transmit the real-time image data to the computer.
And thirdly, after the angular displacement sensor with the transmitting chip is worn on the head of an observer, the displacement of the head of the observer can be synchronously reflected in real time, the angular displacement sensor synchronously acquires the visual angle displacement data of the head of the observer in real time, and the transmitting chip synchronously transmits the visual angle displacement data to the computer in real time. The transmitting chip also synchronously and respectively transmits second pulse signals to the 4 first base stations and the second base station, the first base stations acquire time data when the second pulse signals reach the first base stations, the time data are first data, and the 4 first base stations respectively acquire respective first data.
And thirdly, after the 4 first base stations and the second base station receive the second pulse signal, the second base station synchronously sends third pulse signals to the 4 first base stations respectively, and the third pulse signals are used for synchronizing the starting time of the 4 first base stations in real time.
And thirdly, the first base station acquires time data when the third pulse signal reaches the first base station, the time data is second data, 4 first base stations acquire respective second data, and the 4 first base stations transmit the respective acquired first data and second data to the computer.
And finally, the computer receives the real-time image data and the visual angle displacement data of the 4 cameras and the respective first data and second data of the 4 first base stations, performs comprehensive processing and analysis by combining each duration data of each first base station to obtain missing image data, and displays the missing image by synchronously displaying the missing image data through the flexible screen in real time.
EXAMPLE II
And the flexible screen in the first embodiment is changed into a common display screen, and the others are unchanged.
In the above embodiment, the part of the screen that is missing due to being blocked by the middle barrier 5 is displayed synchronously in real time, and the screen that is missing changes with the movement of the head of the observer, so that the integrity of the screen in the field of view of the observer can be always maintained.
Effects and effects of the embodiments
According to the system for displaying a missing image of the present embodiment, because the design is reasonable, the system for displaying a missing image of the present embodiment can synchronously display a missing image which is missing due to the blocking of the middle rail in the window in real time, and an observer can always synchronously view the complete image outside the window in real time.
The above embodiments are preferred examples of the present invention, and are not intended to limit the scope of the present invention.

Claims (7)

1. A system for displaying a missing image for displaying a real-time synchronized missing image missing from an obstruction in a field of view of an observer, comprising:
the acquisition unit is used for acquiring real-time image data around the obstacle;
the displacement measuring unit comprises a displacement measurer, a plurality of first base stations and a second base station, wherein the displacement measurer is worn on the head of the observer and used for synchronously reflecting the head displacement of the observer in real time, the first base stations are arranged around the observer, the second base stations are arranged nearby the observer, the displacement measurer is respectively in communication connection with the first base stations and the second base stations, and the first base stations are in communication connection with the second base stations;
the analysis unit is arranged near the observer and is respectively in communication connection with the acquisition unit, the displacement measurer and the first base station; and
a display unit arranged on the surface of the barrier close to the observer side and connected with the analysis unit in communication,
wherein the acquisition unit, the displacement measurement unit, the analysis unit, the display unit, the obstacle, and the observer are all on a stationary object,
after the system is arranged, the second base station sends first pulse signals to each first base station, the analysis unit respectively calculates and records the time required by each first base station for receiving the first pulse signals, the time is duration data,
the displacement measurer collects and periodically sends the visual angle displacement data of the head of the observer to the analysis unit,
the displacement measurer also sends a second pulse signal to each of the first base station and the second base station in a timing synchronization manner,
the first base station collects the time data when the second pulse signal reaches the first base station, the time data is first data,
each of the first base stations collects respective first data,
after all the first base stations and the second base stations receive the second pulse signals, the second base station synchronously sends third pulse signals to the first base stations, and the third pulse signals are used for synchronizing the starting time of the first base stations in real time,
the first base station acquires time data when the third pulse signal reaches the first base station, wherein the time data is second data,
each of the first base stations collects respective second data,
the first base station transmits the collected first data and the second data to the analysis unit,
the analysis unit receives the real-time image data, the view displacement data, the first data and the second data of each first base station, and performs comprehensive processing and analysis by combining each duration data of each first base station to obtain the missing image data,
the missing image data is synchronously displayed by the display unit in real time,
the acquisition unit comprises a plurality of camera devices arranged on the barrier or the object,
the display unit is a flexible screen or a common display screen.
2. The system for displaying a missing image as claimed in claim 1, wherein:
wherein the frame of the missing image changes as the movement of the head of the observer changes.
3. The system for displaying a missing image as claimed in claim 1, wherein:
wherein the number of the first base stations is at least three, each of the first base stations is distributed around the observer, the distance from the observer is within 50m, and the distance from the second base station to the observer is within 50 m.
4. The system for displaying a missing image as claimed in claim 1, wherein:
wherein, the displacement measurer is an angular displacement sensor with a transmitting chip.
5. The system for displaying a missing image as claimed in claim 1, wherein:
wherein the shape and size of the display unit are identical to those of the obstacle, covering the entire blocking portion of the obstacle that blocks the view of the observer.
6. The system for displaying a missing image as claimed in claim 1, wherein:
wherein the analysis unit has a processor.
7. A method of arranging the system for displaying a missing image of any of claims 1-6, comprising:
placing the camera device on the obstacle or the object;
secondly, arranging a plurality of first base stations around the observer;
step three, the second base station is placed at the periphery within 50m from the observer;
step four, placing an analysis unit around the observer;
step five, arranging the flexible screen on the whole surface of the barrier close to one side of the observer;
and step six, wearing the displacement measuring device on the head of the observer.
CN201810839367.0A 2018-07-27 2018-07-27 System for displaying missing image and arrangement method Active CN108965644B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810839367.0A CN108965644B (en) 2018-07-27 2018-07-27 System for displaying missing image and arrangement method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810839367.0A CN108965644B (en) 2018-07-27 2018-07-27 System for displaying missing image and arrangement method

Publications (2)

Publication Number Publication Date
CN108965644A CN108965644A (en) 2018-12-07
CN108965644B true CN108965644B (en) 2020-12-01

Family

ID=64464114

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810839367.0A Active CN108965644B (en) 2018-07-27 2018-07-27 System for displaying missing image and arrangement method

Country Status (1)

Country Link
CN (1) CN108965644B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103204105A (en) * 2013-03-23 2013-07-17 苏州佳世达光电有限公司 Head-up display device and method for displaying images on same
CN106143307A (en) * 2016-07-11 2016-11-23 京东方科技集团股份有限公司 A kind of drive assist system and vehicle
CN106799994A (en) * 2017-01-13 2017-06-06 曾令鹏 A kind of method and apparatus for eliminating motor vehicle operator vision dead zone
CN108235427A (en) * 2018-02-07 2018-06-29 南京邮电大学 A kind of method for measuring Tof and Toda

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201385620Y (en) * 2009-03-02 2010-01-20 徐胜 Cab visual disturbance eliminating device
US9129430B2 (en) * 2013-06-25 2015-09-08 Microsoft Technology Licensing, Llc Indicating out-of-view augmented reality images
CN103358996B (en) * 2013-08-13 2015-04-29 吉林大学 Automobile A pillar perspective vehicle-mounted display device
US9428056B2 (en) * 2014-03-11 2016-08-30 Textron Innovations, Inc. Adjustable synthetic vision
JP6539654B2 (en) * 2014-06-27 2019-07-03 フォーブ インコーポレーテッド Gaze detection device
KR102275778B1 (en) * 2014-12-04 2021-07-09 삼성디스플레이 주식회사 Head mounted display device
CN204641550U (en) * 2015-03-31 2015-09-16 上海通用汽车有限公司 Vehicular visual blind area display system and vehicle
KR101822894B1 (en) * 2016-04-07 2018-01-29 엘지전자 주식회사 Driver assistance apparatus and Vehicle
CN105857181A (en) * 2016-05-12 2016-08-17 镇江市丹徒区硕源材料科技有限公司 Device system for eliminating pillar A dead zones

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103204105A (en) * 2013-03-23 2013-07-17 苏州佳世达光电有限公司 Head-up display device and method for displaying images on same
CN106143307A (en) * 2016-07-11 2016-11-23 京东方科技集团股份有限公司 A kind of drive assist system and vehicle
CN106799994A (en) * 2017-01-13 2017-06-06 曾令鹏 A kind of method and apparatus for eliminating motor vehicle operator vision dead zone
CN108235427A (en) * 2018-02-07 2018-06-29 南京邮电大学 A kind of method for measuring Tof and Toda

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
A new method for wireless synchronization and TDOA error reduction in UWB positioning system;Vitomir Djaja-Josko et al;《2016 21st International Conference on Microwave, Radar and Wireless Communications (MIKON)》;20160616;全文 *
基于自适应卡尔曼滤波的超宽带室内定位系统;童基均等;《测试技术学报》;20180514;全文 *

Also Published As

Publication number Publication date
CN108965644A (en) 2018-12-07

Similar Documents

Publication Publication Date Title
KR101073076B1 (en) Fire monitoring system and method using compound camera
CN105940429B (en) For determining the method and system of the estimation of equipment moving
US20140078263A1 (en) Monitoring apparatus and system using 3d information of images and monitoring method using the same
US20130271579A1 (en) Mobile Stereo Device: Stereo Imaging, Measurement and 3D Scene Reconstruction with Mobile Devices such as Tablet Computers and Smart Phones
KR20160130217A (en) Methods and systems for generating a map including sparse and dense mapping information
WO2008071000A1 (en) System and method for obtaining and using advertising information
CN103471512A (en) Glass plate width detection system based on machine vision
WO2007055943B1 (en) Multi-user stereoscopic 3-d panoramic vision system and method
US20170018092A1 (en) Odometry Feature Matching
US8289393B2 (en) Camera control unit, camera display system, and camera control method
CN109327676A (en) A kind of falling object from high altitude monitoring system, method and device
CN106781276A (en) A kind of old man's abnormal behaviour monitoring system
CN107728224A (en) A kind of passive terahertz imaging system based on focal plane scanning
CN104091450B (en) A kind of video frequency velometer and video frequency speed-measuring method
CN108965644B (en) System for displaying missing image and arrangement method
CN109974860A (en) Based on thermal imaging coal mine down-hole personnel monitoring system
CN108919960B (en) System for displaying missing image
JP2012177569A (en) Development image acquisition system for tunnel wall surface
CN103234514B (en) Methods for distance measurement and offset measurement with single camera and for realizing naked eye 3D grating adjustment
EP3819590A1 (en) Management system and management method using eyewear device
RU108136U1 (en) COMPLEX OF PANORAMIC VIDEO SURVEILLANCE AND TERRITORY CONTROL
CN109109744B (en) System for displaying missing image and arrangement method
CN109109745B (en) System for displaying missing image
CN102339465A (en) Method and system for detecting the mutual closing and/or contact of moving objects
CN212779573U (en) Thermal imaging temperature measurement system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20240110

Address after: Room 1404, Building 3, Zhangzhou Zhonghai 2017P03, No. 12 Shicang South Road, Longwen District, Zhangzhou City, Fujian Province, 363000

Patentee after: Zhangzhou Longwen Shipeng Information Technology Co.,Ltd.

Address before: 200093 No. 516, military road, Shanghai, Yangpu District

Patentee before: University of Shanghai for Science and Technology

TR01 Transfer of patent right