JP2013033426A - Snow removal support system and snow removal vehicle - Google Patents

Snow removal support system and snow removal vehicle Download PDF

Info

Publication number
JP2013033426A
JP2013033426A JP2011170087A JP2011170087A JP2013033426A JP 2013033426 A JP2013033426 A JP 2013033426A JP 2011170087 A JP2011170087 A JP 2011170087A JP 2011170087 A JP2011170087 A JP 2011170087A JP 2013033426 A JP2013033426 A JP 2013033426A
Authority
JP
Japan
Prior art keywords
vehicle
snow removal
coordinates
video
snow
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
JP2011170087A
Other languages
Japanese (ja)
Inventor
Toshio Suenaga
利夫 末永
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
JOCHI KK
Original Assignee
JOCHI KK
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by JOCHI KK filed Critical JOCHI KK
Priority to JP2011170087A priority Critical patent/JP2013033426A/en
Publication of JP2013033426A publication Critical patent/JP2013033426A/en
Withdrawn legal-status Critical Current

Links

Landscapes

  • Instructional Devices (AREA)
  • Cleaning Of Streets, Tracks, Or Beaches (AREA)
  • Navigation (AREA)
  • Traffic Control Systems (AREA)

Abstract

PROBLEM TO BE SOLVED: To provide a snow removal support system which enables a user to easily and safely perform snow removal work by accurately recognizing positional relations between structures like obstacles and a snow removal vehicle through viewing and coordinate calculation on the basis of real video images acquired during the absence of accumulated snow.SOLUTION: The snow removal support system includes; video image recording means 1 which records real video images in all directions, which have been simultaneously acquired during the absence of accumulated snow by imaging means 1a, in association with vehicle coordinates in an absolute coordinate system, moving directions, etc. of a vehicle A at the time of video image acquisition; video image output means 4 which reads out a real video image corresponding to vehicle coordinates and a moving direction or the like derived from a desired line of sight, from the video image recording means 1 and outputs the real video image to a display frame F; and structure recording means 5 which reads out absolute coordinates of feature points included in the real video image read out from the video image recording means 1, from the video image recording means 1 to generate a three-dimensional model of the absolute coordinate system.

Description

本発明は、無積雪時における画像を表示しつつ除雪を行うための除雪支援システム及びそれを用いた除雪車に関する。   The present invention relates to a snow removal support system for performing snow removal while displaying an image when there is no snow, and a snow removal vehicle using the snow removal support system.

従来の除雪支援装置又はそのシステムとして、除雪車が走行する際、GPSの位置データにリンクした無積雪時における道路のCG画像を表示して除雪作業を支援する道路除雪ナビゲーションシステム(例えば下記特許文献1参照)が紹介されている。   As a conventional snow removal support apparatus or system thereof, a road snow removal navigation system that supports snow removal work by displaying a CG image of a road when there is no snow linked to GPS position data when a snow removal vehicle travels (for example, the following patent document) 1) is introduced.

更に、除雪作業の精度を、電子地図上に障害物情報として関連付ける等、高精度の位置情報に依存する手法(例えば下記特許文献2参照)、溝、縁石、ガードレール等の構造物の位置情報に基いて記載したCG画像によるデジタルマップを併用する手法(例えば下記特許文献3参照)が紹介されている。
また、除雪の際、ブレードが集めた雪を交差点等の分岐箇所に積み上げることなく側方へ排出できるように、サイドシャッタの解放スイッチの選択、又はマーカーの検出によって閉鎖板を開閉する手法を採った手段もある(例えば下記特許文献4参照)。
In addition, the accuracy of snow removal work is related to the position information of structures such as grooves, curbs, guardrails, and the like that depend on high-accuracy position information, such as associating obstacle information on an electronic map. A method of using a digital map based on a CG image described on the basis (for example, see Patent Document 3 below) is introduced.
In addition, when removing snow, a technique is adopted that opens and closes the closing plate by selecting the release switch of the side shutter or detecting the marker so that the snow collected by the blade can be discharged to the side without being piled up at a branching point such as an intersection. (For example, refer to Patent Document 4 below).

特開2002−333325号公報JP 2002-333325 A 特許第3852779号公報Japanese Patent No. 3852779 特開2008−224625号公報JP 2008-224625 A 特開平5−287715号公報Japanese Patent Laid-Open No. 5-287715

しかしながら、上記特許文献1乃至3のいずれに記載の手法にあっても、二次元の平面的なCG画像やデジタル情報がメインであって、不足する情報を実写映像で補完する形態を採っているので、実写映像に表示される構造物や除雪車等のサイズや距離を、実際のものとしてそのまま受け入れることが出来ず、障害物等の構造物との安全な距離を視角的に感得し辛いという問題がある。こう言った問題を解消する措置としても、従来、特許文献4に記載の様に、マーカー等を予め設置し車両との相対距離を導いてアラーム等を出力する措置を講ずるに止まっていた。   However, in any of the methods described in Patent Documents 1 to 3, a two-dimensional planar CG image and digital information are main, and a form in which the lacking information is supplemented with a live-action video is adopted. Therefore, the size and distance of structures and snowplows displayed in live-action images cannot be accepted as they are, and it is difficult to visually sense the safe distance from structures such as obstacles. There is a problem. Conventionally, as a measure for solving such a problem, as described in Japanese Patent Application Laid-Open No. 2004-228561, a measure such as setting a marker or the like in advance and guiding a relative distance from the vehicle to output an alarm or the like has been taken.

本発明は、上記実情に鑑みて為されたものであって、無積雪時の実写映像に基づき障害物等の構造物と除雪車との位置関係を目視上及び座標計算上で正確に把握することによって、容易に且つ安全に除雪作業を行うことができる除雪支援システム及びそれを用いた除雪車の提供を目的とする。   The present invention has been made in view of the above circumstances, and accurately grasps the positional relationship between a structure such as an obstacle and a snowplow on the basis of a live-action image when there is no snow on the ground and in coordinate calculation. Accordingly, an object of the present invention is to provide a snow removal support system that can easily and safely perform snow removal work and a snow removal vehicle using the snow removal support system.

上記課題を解決するためになされた本発明による除雪支援システムは、無積雪時に撮像手段で同時取得した全方位(前後左右360度に亘り撮像手段の視野を以って得た映像)の実写映像を、映像取得時の車両の絶対座標系における車両座標(全地球測位による三次元座標系の車両座標)、移動方向、及び撮像手段の姿勢情報と結び付けて記録する映像記録手段と、現時点の車両の絶対座標系における車両座標を取得する車両座標検出手段と、現時点の車両の絶対座標系における移動方向を導く移動方向検出手段、現時点の車両の絶対座標系における車両座標並びに所望の視線(通常は運転者の視線に設定すれば良いが、必要に応じて視線を適宜調整しても良い。)から導かれる移動方向及び姿勢情報に対応する実写映像(同じ車両座標において、所望の視線から複数の移動方向及び姿勢情報の組み合わせが導かれる場合があり、それらの組み合わせのいずれを選択しても同様の実写映像が導かれるはずである。)を前記映像記録手段から読み出し表示フレームに出力する映像出力手段と、当該映像出力手段が前記映像記録手段から読み出した実写映像に含まれる特徴点の絶対座標系における位置座標を導き保存する構造物記録手段を備えることを特徴とする。   The snow removal support system according to the present invention, which has been made to solve the above-mentioned problems, is a live-action image of all directions (images obtained from the field of view of the imaging means over 360 degrees in the front-rear and left-right directions) simultaneously acquired by the imaging means when there is no snow. Video recording means for recording the vehicle coordinates in the absolute coordinate system of the vehicle at the time of video acquisition (vehicle coordinates in the three-dimensional coordinate system by global positioning), the moving direction, and the attitude information of the imaging means, and the current vehicle Vehicle coordinate detection means for obtaining vehicle coordinates in the absolute coordinate system, movement direction detection means for deriving the movement direction in the absolute coordinate system of the current vehicle, vehicle coordinates in the absolute coordinate system of the current vehicle, and a desired line of sight (usually (It may be set to the driver's line of sight, but the line of sight may be adjusted as necessary.) In other cases, a combination of a plurality of movement directions and posture information may be derived from a desired line of sight, and any of these combinations should be selected, and a similar live-action video should be derived from the video recording means. Video output means for outputting to a read display frame, and structure recording means for deriving and storing position coordinates in the absolute coordinate system of feature points included in the actual video read by the video output means from the video recording means And

前記構造物記録手段としては、例えば、実写映像に含まれる構造物の特徴点に対する二つの任意の撮影点を結ぶ線分の長さを導くと共に、当該線分と前記各撮影点から各々当該特徴点を結ぶ線分との角度を導き、前方交会法における演算処理によって特徴点の全地球測位による三次元座標系の位置座標を導く座標算出手段を備えたもので良く、前記座標算出手段は、当該特徴点を含む取得フレームを撮影した時点の車両座標を撮影点とし、前記角度を、当該特徴点を撮影した時点の車両座標、移動方向、及び撮像手段の姿勢情報、並びに当該特徴点を含む取得フレームのピクセル座標から算出することができる。
当該座標算出手段で導いた位置座標に基づき特徴点を全地球測位による三次元座標系に配置する配置手段を備えたものであっても良い。
尚、前記ピクセル座標とは、取得フレーム又は表示フレームの表示面を共通の二次元直交座標系(以下相対座標系と記す)で表現した座標であって、取得フレーム又は表示フレームの中心又は四隅のいずれかを原点とするものである(以下相対座標と記す)。
As the structure recording means, for example, the length of a line segment connecting two arbitrary shooting points with respect to the feature point of the structure included in the live-action video is derived, and the feature is respectively detected from the line segment and each shooting point. It may be provided with a coordinate calculation means for deriving an angle with a line segment connecting points and deriving a position coordinate of a three-dimensional coordinate system by global positioning of a feature point by a calculation process in a forward intersection method, The vehicle coordinates at the time of capturing the acquisition frame including the feature point are used as the capturing points, and the angle includes the vehicle coordinates at the time of capturing the feature point, the moving direction, the posture information of the imaging unit, and the feature points. It can be calculated from the pixel coordinates of the acquisition frame.
There may be provided arrangement means for arranging the feature points in a three-dimensional coordinate system based on global positioning based on the position coordinates derived by the coordinate calculation means.
The pixel coordinates are coordinates that represent the display surface of the acquisition frame or display frame in a common two-dimensional orthogonal coordinate system (hereinafter referred to as a relative coordinate system), and are the center or four corners of the acquisition frame or display frame. Either one is the origin (hereinafter referred to as relative coordinates).

前記映像出力手段は、車両座標又は指定座標を含む一定の領域の地図映像を出力する映像編集手段を備える構成としても良く、その際、当該映像編集手段は、取得した実写映像の複数の取得フレームに含まれる平面映像を連結する結合手段を備える構成とすることができる。   The video output unit may include a video editing unit that outputs a map video of a certain region including vehicle coordinates or designated coordinates, and in this case, the video editing unit includes a plurality of acquisition frames of the acquired live-action video. It is possible to have a configuration including coupling means for coupling the plane images included in the.

前記構造物記録手段は、車両座標又は指定座標を含む一定の領域についての地図画像を出力する画像編集手段を備える構成としても良く、その際、当該画像編集手段は、取得した実写映像の複数の取得フレームに含まれる特徴点を絶対座標系における二次元の水平面(X−Y平面)に配置する配置手段を備える構成とすることができる。   The structure recording unit may include an image editing unit that outputs a map image for a certain region including vehicle coordinates or designated coordinates, and in that case, the image editing unit includes a plurality of captured real video images. It can be set as the structure provided with the arrangement | positioning means which arrange | positions the feature point contained in an acquisition frame on the two-dimensional horizontal surface (XY plane) in an absolute coordinate system.

例えば、当該特徴点の絶対座標系における位置座標と属性を結び付けて記録する等、前記特徴点に属性を与える定義手段を備える構成としても良い。特に、監視対象となる特徴点には、監視対象と特定する属性(監視属性)を与えることもでき、更に、車両の属性を持つ特徴点と監視属性を有する特徴点との距離を各々の絶対座標系における位置座標より導く距離算出手段と、車両の属性を持つ特徴点と監視属性を有する特徴点との距離が所定の距離以内である場合にアラーム出力を発する警報手段を備える構成とすることもできる。   For example, a configuration may be provided that includes definition means for giving an attribute to the feature point, such as recording the position coordinate of the feature point in the absolute coordinate system in association with the attribute. In particular, an attribute (monitoring attribute) that identifies the object to be monitored can be given to the feature point to be monitored, and further, the distance between the feature point having the attribute of the vehicle and the feature point having the monitor attribute can be determined as absolute A distance calculation means derived from position coordinates in the coordinate system and a warning means for issuing an alarm output when the distance between the feature point having the vehicle attribute and the feature point having the monitoring attribute is within a predetermined distance. You can also.

上記アラーム出力の出し方には、現時点の車両座標を基準として、例えば、実際の路上における排雪禁止区間の始点に固定したICタグ及び終点に固定したICタグに至る距離又は各ICタグへの方向を導く距離算出手段と、当該距離の増減又は方向の変化を検出し排雪禁止区間でアラーム出力を発する警報手段を備える構成とすることもできる。   The method of issuing the alarm output is based on the current vehicle coordinates, for example, the distance to the IC tag fixed to the start point and the IC tag fixed to the end point of the snow removal prohibition section on the actual road, or to each IC tag A distance calculating means for guiding the direction and an alarm means for detecting an increase / decrease in the distance or a change in the direction and generating an alarm output in the snow removal prohibition section may be provided.

上記アラーム出力を活用するものであって、上記課題を解決するためになされた本発明による除雪車は、前記警報手段を持つ除雪支援システムと、路上の雪を掻き集める除雪板と、当該除雪板の対雪面に沿って側方へ流れる雪の排雪を止める開閉可能な閉鎖板と、前記警報手段が発するアラーム出力を受けて閉鎖板を開閉する開閉制御手段を備えることを特徴とする。   The snowplow according to the present invention, which utilizes the alarm output and is made to solve the above problems, includes a snow removal support system having the alarm means, a snow removal board for scraping snow on the road, and the snow removal board. And a closing plate that can be opened and closed to stop the snow drainage of the snow flowing laterally along the snow surface, and an opening and closing control means that opens and closes the closing plate in response to an alarm output from the alarm means.

以上の如く本発明による除雪支援システム及び除雪車によれば、道路沿道の景観や標識、看板などの道路施設が切れ目なく確認でき、除雪車等の運用車両をその表示フレーム内に介在させれば、道路施設と除雪車との位置関係も正確に把握することができる。
これによって、障害物等の構造物のサイズを運転者が判断するまでもなく、表示された実写映像を信頼して安全に除雪作業を行うことができる。
As described above, according to the snow removal support system and the snowplow according to the present invention, road facilities such as roadside scenery, signs, signboards and the like can be confirmed without any breaks, and an operation vehicle such as a snowplow is interposed in the display frame. In addition, the positional relationship between the road facility and the snowplow can be accurately grasped.
Thus, the snow removal operation can be performed safely by relying on the displayed live-action image without the driver having to determine the size of the structure such as an obstacle.

映像編集手段や画像編集手段を設けると共に、その視線を適宜変更できる構造とすれば、撮影点の座標と視線を変化させることによって、撮影時の走行位置からは見えない領域であっても、切れ目ない画像で確認することができる他、それらを平面映像又は平面画像として出力すれば、地図として走行位置と道路沿道の景観等を関連付けて除雪計画を練ることが容易となる。   By providing video editing means and image editing means and having a structure that can change the line of sight appropriately, even if the area is invisible from the travel position at the time of shooting by changing the coordinates and line of sight of the shooting point, In addition to being able to confirm with no image, if they are output as a plane image or a plane image, it becomes easy to devise a snow removal plan by associating the travel position with the landscape along the road as a map.

また、実写映像に含まれる特徴点の絶対座標系における位置座標を導き保存する構造物記録手段を備えることから、各種制御の用に供される特徴点と実写映像とが相互に結び付けられ、実写映像に映る構造物等のどの部分に注意を払うべきなのかを容易に把握することができる。   In addition, since it has a structure recording means for deriving and storing the position coordinates of the feature points included in the live-action image in the absolute coordinate system, the feature points used for various controls and the live-action image are linked to each other, It is possible to easily grasp which part of the structure or the like shown in the image should be paid attention to.

実写映像の複数の特徴点の位置座標に構造物等の属性を与え、相互に結び付けて保存する定義手段を備えることによって、除雪支援システムにおける構造物認識の正確さが高まり、属性毎に識別可能なパターンを実写映像に割り付ける手段を備えれば、ディスプレイ装置等に走行位置の道路状況を表示した際や地図として出力した際において、各構造物等の境界、属性の視認性を高めることができる。   By providing a definition means that assigns attributes such as structures to the position coordinates of multiple feature points in a live-action video and connects them to each other and saves them, the accuracy of structure recognition in the snow removal support system increases and can be identified for each attribute If a means for assigning a simple pattern to a live-action image is provided, the visibility of boundaries and attributes of each structure and the like can be improved when the road condition of the running position is displayed on a display device or when it is output as a map. .

加えて、前記定義手段において、構造物マップの特徴点に障害物又は交差点(道路や出入り口を含む)の属性を与え、又は実際の道路にICタグを固定すると共に、除雪車の位置座標から所定の距離以内に障害物の属性を持つ特徴点又はICタグが存在する場合にアラーム出力を発する警報手段を備えることによって、作業者への注意喚起にも寄与することとなる。   In addition, in the definition means, an attribute of an obstacle or an intersection (including a road and an entrance / exit) is given to a feature point of the structure map, or an IC tag is fixed to an actual road and a predetermined position is determined from the position coordinates of the snowplow. By providing a warning means for issuing an alarm output when there is a feature point or IC tag having an obstacle attribute within a distance of, this also contributes to alerting the worker.

更に、前記警報手段から発せられるアラーム出力を受けて閉鎖板を閉じる閉鎖板制御手段を備えれば、除雪した雪が所構わず放置されることによる通行障害を回避することもできる。   Further, if the closing plate control means for closing the closing plate in response to the alarm output from the warning means is provided, it is possible to avoid a traffic obstacle caused by leaving the snow removed from snow regardless of where it is left.

本発明による除雪支援システムでの処理の一例を示すフローチャートである。It is a flowchart which shows an example of the process in the snow removal assistance system by this invention. 本発明による除雪支援システムの一例を示すブロック図である。It is a block diagram which shows an example of the snow removal assistance system by this invention. 本発明による除雪支援システムの(A):映像出力手段の処理、(B):構造物記録手段おける座標算出手段の処理の一例を示すフローチャートである。It is a flowchart which shows an example of the process of the coordinate calculation means in (A): Video output means of the snow removal assistance system by this invention, (B): Structure recording means. 本発明による除雪支援システムでの位置座標算出手段に要する(A):姿勢情報を導出するイメージ、(B):前方交会法による処理のイメージの一例を示す説明図である。の一例を示す説明図である。It is explanatory drawing which shows an example of (A): Image which derives | leads-out attitude | position information required for the position coordinate calculation means in the snow removal assistance system by this invention, (B): The image of the process by a forward intersection method. It is explanatory drawing which shows an example. 本発明による除雪支援システムの(A):撮影走行に用いる設備、(B): 除雪板及び閉鎖板の配置状態の一例を示す説明図である。It is explanatory drawing which shows an example of the arrangement | positioning state of (A): Equipment used for imaging | photography driving | running | working, (B): Snow removal board and closing board of the snow removal assistance system by this invention. 本発明による除雪車での閉鎖板の開閉状態の一例を示す説明図である。It is explanatory drawing which shows an example of the opening / closing state of the closing board in the snowplow by this invention. 本発明による除雪支援システムの表示フレームの出力態様の一例を示す写真である。It is a photograph which shows an example of the output mode of the display frame of the snow removal assistance system by this invention.

以下、本発明による除雪支援システム及び除雪車の実施の形態を図面に基づき説明する。   DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments of a snow removal support system and a snowplow according to the present invention will be described with reference to the drawings.

図1に示す除雪支援システムは、
除雪車たる車両Aの全地球測位による三次元座標系(以下絶対座標系と記す)の車両座標及び検出時の時刻を取得する車両座標検出手段2と、
現時点の車両Aの絶対座標系における移動方向を取得する移動方向検出手段3と、
無積雪時に撮像手段1aで同時取得した全方位の実写映像を、映像取得時の車両Aの絶対座標系の車両座標、移動方向、及び撮像手段1aの姿勢情報(撮像手段1aの水平面に対する傾斜を示す情報等)と結び付けて記録する映像記録手段1と、
現時点の車両座標、並びに所望の視線から導いた移動方向及び姿勢情報に対応する実写映像データを前記映像記録手段1から読み出し表示フレームFに区画して出力する映像出力手段4と、
当該映像出力手段4が前記映像記録手段1から読み出した実写映像に含まれる特徴点の絶対座標を導き保存する構造物記録手段5を備えるものである。
The snow removal support system shown in FIG.
Vehicle coordinate detection means 2 for acquiring the vehicle coordinates of a three-dimensional coordinate system (hereinafter referred to as an absolute coordinate system) based on the global positioning of the vehicle A as a snowplow and the time at detection;
A moving direction detecting means 3 for acquiring a moving direction in the absolute coordinate system of the vehicle A at the present time;
The omnidirectional real-time image simultaneously acquired by the image pickup means 1a when there is no snow, the vehicle coordinate in the absolute coordinate system of the vehicle A, the moving direction, and the posture information of the image pickup means 1a (the inclination of the image pickup means 1a with respect to the horizontal plane) Video recording means 1 for recording in association with information, etc.
Video output means 4 for reading out the actual video data corresponding to the current vehicle coordinates and the moving direction and posture information derived from the desired line of sight from the video recording means 1 and dividing it into a display frame F;
The video output means 4 includes structure recording means 5 for deriving and storing the absolute coordinates of the feature points included in the actual video read from the video recording means 1.

ここで、所望の視線とは、通常は、運転手の視線として設定した視線であって、車両Aを運転手が車窓を通して車外を見る際に生じ得る視線の中から選択した一の視線であればよい。その他、運転手の視線とは無関係に、運用者が目視することを望む箇所に向かう車両座標及び視線を適宜設定しても良い。   Here, the desired line of sight is normally the line of sight set as the driver's line of sight, and may be one line of sight that may be generated when the driver looks outside the vehicle through the vehicle window. That's fine. In addition, regardless of the driver's line of sight, the vehicle coordinates and line of sight toward the location that the operator desires to view may be set as appropriate.

当該例における車両座標検出手段2は、地球の周りを廻る複数の人工衛星から継続的に車両Aの絶対座標系の車両座標とその検出時の時刻を取得し出力するGPS(Global Positioning Sistem)である。   The vehicle coordinate detection means 2 in this example is a GPS (Global Positioning System) that continuously acquires and outputs the vehicle coordinates in the absolute coordinate system of the vehicle A and the time at the time of detection from a plurality of artificial satellites orbiting around the earth. is there.

当該例における車両座標検出手段2は、更に、相互に直行する三軸方向への加速度ベクトルを検知する加速度センサ2aを備える。当該加速度センサ2aで得た相対的な加速度ベクトルから、相対的な速度ベクトル及び移動ベクトルを算出し、GPSにおける衛星非検出時、及びトンネル走行時等において、車両座標検出に算入すると共に、前記移動方向検出手段3としての機能を果たす。   The vehicle coordinate detection means 2 in this example further includes an acceleration sensor 2a that detects acceleration vectors in three axial directions orthogonal to each other. A relative velocity vector and a movement vector are calculated from the relative acceleration vector obtained by the acceleration sensor 2a, and are included in the vehicle coordinate detection when the satellite is not detected by GPS or when traveling in a tunnel. It functions as the direction detection means 3.

当該例における映像記録手段1は、最新映像を撮影できる複数のCCD(撮像手段)1aを備えたカメラと、当該カメラを車両Aに支持するアタッチメントと、カメラの傾斜等の支持状況を出力に反映する姿勢センサ1bと、各CCD1a及び姿勢センサ1bが出力した実写映像の各フレーム(取得フレーム)及びその際の姿勢情報を組み合わせて記録する保存手段を備える。   The video recording means 1 in this example reflects in the output a camera having a plurality of CCDs (imaging means) 1a capable of taking the latest video, an attachment that supports the camera on the vehicle A, and the support status such as the tilt of the camera. And a storage unit that records each frame (acquisition frame) of the captured image output by each CCD 1a and posture sensor 1b and posture information at that time in combination.

当該例におけるカメラは、全方向(当該例では上下前後左右からなる六方向)の実写映像(カメラを搭載した車両Aの映像を含む)を同時撮影するための六個のCCD1aを備え、各CCD1aの実写映像データを個別に出力するものである。前記姿勢センサ1bは、相互に位置関係が固定された六個のCCD1aの傾斜を各CCD1aの位置関係に照らして一括して検出する。尚、一個のCCD1aについて、全方向の映像を取得できる光学系レンズを利用して一のCCD1aで一個のパノラマ画像を取得できる構造としても良い。   The camera in this example includes six CCDs 1a for simultaneously capturing real-time images (including images of the vehicle A equipped with the camera) in all directions (six directions including up, down, front, back, left, and right in this example). The actual video data is output individually. The posture sensor 1b collectively detects the inclinations of the six CCDs 1a whose positional relationships are fixed with respect to the positional relationships of the CCDs 1a. In addition, about one CCD1a, it is good also as a structure which can acquire one panoramic image with one CCD1a using the optical system lens which can acquire the image | video of all directions.

当該例における姿勢センサ1bは、前記CCD1aの撮影方向の方位角と仰俯角を測定し、車両Aの前方0°から360°の方位角と車両Aの下方−90°から90°の仰俯角で、カメラの基準姿勢(例えば、方位角0°仰俯角0°の姿勢)に対する相対的な姿勢を特定しそれらを姿勢情報として出力する。   The posture sensor 1b in this example measures the azimuth angle and elevation angle in the photographing direction of the CCD 1a, and the azimuth angle from 0 ° to 360 ° ahead of the vehicle A and the elevation angle from −90 ° to 90 ° below the vehicle A. Then, a relative posture with respect to the reference posture of the camera (for example, a posture with an azimuth angle of 0 ° and an elevation angle of 0 °) is specified and output as posture information.

当該例における映像記録手段1は、前記CCD1aが出力した実写映像を、その取得フレーム毎に、映像取得時における姿勢センサ1bが出力した姿勢情報、並びに車両Aの移動方向、GPSで取得した車両座標及び時刻等と相互に関連付けた映像情報としてメモリなど所定の保存手段に記録する。   In this example, the video recording means 1 uses the posture information output by the posture sensor 1b at the time of video acquisition, the moving direction of the vehicle A, and the vehicle coordinates acquired by the GPS for each acquisition frame of the actual video output from the CCD 1a. In addition, it is recorded in predetermined storage means such as a memory as video information correlated with time and the like.

この様な構成を持つ映像記録手段1を備えれば、道路及びその沿道の状況の変化に応じて、保存手段の映像情報を適宜更新することができる。この様に、上記例では最新の道路状況を適宜撮影できる撮像手段1aを備えた映像記録手段1を採用したが、予め撮影した除雪対象地域の映像情報等を適宜入力し、それらを除雪に運用することのみを機能とするものでも良い。尚、取得し入力される映像の視線や視野にあっては、除雪対象地域に応じて適当な方位角と仰俯角で定まる範囲で決めれば良い。   If the video recording means 1 having such a configuration is provided, the video information in the storage means can be appropriately updated in accordance with changes in the road and its roadside conditions. As described above, in the above example, the video recording unit 1 including the imaging unit 1a capable of appropriately capturing the latest road conditions is employed. However, the video information of the snow removal target area previously captured is appropriately input and used for snow removal. It may be a function that only functions. Note that the line of sight and field of view of the acquired and input video may be determined within a range determined by an appropriate azimuth and elevation depending on the snow removal target area.

当該例における映像出力手段4は、視線解析手段4b、結合手段4c、及び映像編集手段4aを備える。
映像出力手段4は、視線解析手段4bを以って、車両座標及び設定された視線から、その組み合わせに対応する車両Aの移動方向及び姿勢情報を導き、当該車両座標、車両Aの移動方向、及び姿勢情報に対応した実写映像を映像記録手段1から読み出し、表示フレームFに区画してディスプレイ等に出力する(表示フレームFに車両Aの実写映像を含ませる場合もある)。
尚、この例では、前記姿勢情報で定まる視線は、出力される表示フレームFの中央を向いているものとし、視野は、原則として実写映像取得時のままである。
The video output unit 4 in this example includes a line-of-sight analysis unit 4b, a coupling unit 4c, and a video editing unit 4a.
The video output means 4 derives the movement direction and posture information of the vehicle A corresponding to the combination from the vehicle coordinates and the set line of sight by the line-of-sight analysis means 4b, and the vehicle coordinates, the movement direction of the vehicle A, Then, a live-action video corresponding to the posture information is read from the video recording means 1 and is divided into display frames F and output to a display or the like (the real-time video of the vehicle A may be included in the display frame F in some cases).
In this example, it is assumed that the line of sight determined by the posture information is directed to the center of the output display frame F, and the visual field remains as it is at the time of acquisition of a live-action video in principle.

映像記録手段1に、設定された視線から導かれる車両座標及び車両Aの移動方向、並びに姿勢情報に対応した映像情報が存在しない場合には、映像出力手段4は、映像編集手段4aを以って、当該車両座標及び視線が最も近似する(好ましくは、視野の一部も一致する)複数の実写映像を、各取得フレームに含まれる地点(特徴点を含む)の絶対座標系の位置座標(以下絶対座標と記す)に基いて連結し、表示フレームFに区画して出力する。   When there is no video information corresponding to the vehicle coordinates derived from the set line of sight, the moving direction of the vehicle A, and the posture information in the video recording unit 1, the video output unit 4 includes the video editing unit 4a. Thus, the position coordinates (including the feature points) of the points (including the feature points) included in each acquisition frame are a plurality of live-action images that have the closest vehicle coordinates and line-of-sight (preferably, a part of the field of view also matches). (Hereinafter referred to as absolute coordinates), and is divided into display frames F for output.

また、当該例における映像編集手段4aは、車両座標又は指定座標(絶対座標系)を中心とする一定の領域について、実写映像として取得した複数の取得フレームにおいて車両Aに隠れていない地表部分を重畳的に配置連結する結合手段4cを備え、映像出力手段4は、当該処理で得た平面映像を出力する。当該平面映像は、実写地図として利用することができる。   In addition, the video editing unit 4a in the example superimposes a ground surface portion that is not hidden by the vehicle A in a plurality of acquisition frames acquired as a live-action video for a certain area centered on the vehicle coordinates or specified coordinates (absolute coordinate system). The image output means 4 outputs a plane image obtained by the processing. The plane image can be used as a live-action map.

一方、当該例における構造物記録手段5は、座標算出手段5a、配置手段5d、結合手段5b、及び画像編集手段5c、特徴点表示手段5f、並びに定義手段5eを備え、当該映像出力手段4が前記映像記録手段1から読み出した実写映像に含まれる特徴点の絶対座標を導き保存する。   On the other hand, the structure recording unit 5 in the example includes a coordinate calculation unit 5a, an arrangement unit 5d, a combination unit 5b, an image editing unit 5c, a feature point display unit 5f, and a definition unit 5e. The absolute coordinates of the feature points included in the actual video read from the video recording means 1 are derived and stored.

当該例における座標算出手段5aは、映像記録手段1に記録した映像情報から実写映像に含まれた座標算出の対象とする点(特徴点)を抽出すると共に、抽出した各特徴点について各取得フレーム上でのピクセル座標を導き、当該取得フレームに係る映像情報(取得時における姿勢情報、車両座標、及び移動方向)から各特徴点の絶対座標を導くものである(図3(B)及び図4参照)。   The coordinate calculation means 5a in this example extracts points (feature points) to be subjected to coordinate calculation included in the live-action video from the video information recorded in the video recording means 1, and each acquired frame for each extracted feature point. The pixel coordinates above are derived, and the absolute coordinates of each feature point are derived from the video information (posture information at the time of acquisition, vehicle coordinates, and movement direction) related to the acquisition frame (FIGS. 3B and 4). reference).

即ち、前記座標算出手段5aは、例えば、実写映像における任意の特徴点に対する二つの任意の撮影点(車両座標(X1,Y1,Z1),(X2,Y2,Z2))を結ぶ線分の長さLを各撮影点から当該特徴点を含む取得フレームを撮影した時点の車両座標より算出すると共に、当該線分と前記各撮影点から各々当該特徴手を結ぶ線分とで成す角度θ1,θ2を、各撮影点から当該特徴点を撮影した時点における車両座標、姿勢情報((方位角,仰俯角):(θx1,θz1),(θx2,θz2))、及び特徴点を含んだ取得フレームにおける特徴点の相対座標(x1,y1),(x2,y2)から各々導き(図4(A)参照)、前方交会法(図4(B)参照)における演算処理等によって特徴点の絶対座標(X,Y,Z)を導くものである。   That is, the coordinate calculation means 5a is, for example, the length of a line segment connecting two arbitrary shooting points (vehicle coordinates (X1, Y1, Z1), (X2, Y2, Z2)) with respect to an arbitrary feature point in a live-action image. The length L is calculated from the vehicle coordinates at the time of capturing an acquisition frame including the feature point from each shooting point, and the angles θ1 and θ2 formed by the line segment and the line segment connecting the feature hand from the shooting point respectively. In an acquisition frame including vehicle coordinates, posture information ((azimuth angle, elevation angle): (θx1, θz1), (θx2, θz2)), and feature points at the time when the feature points were shot from each shooting point. The absolute coordinates of the feature points (see FIG. 4A) are derived from the relative coordinates (x1, y1) and (x2, y2) of the feature points, respectively, and are calculated by arithmetic processing in the forward intersection method (see FIG. 4B). X, Y, Z).

この様な演算処理によれば、実写映像とそれに含まれる各特徴点とを、共通の絶対座標系で結び付けることができる。
尚、これらの処理は、必ずしも映像記録手段1に収められた取得フレーム全てについて行うことを要請するものではなく、少なくとも表示フレームFに出力されている実写映像データに含まれる特徴点のみについて行えば良い。当該例における車両座標については、任意の取得フレームとその直前直後の取得フレームとの間で鉛直方向の座標の比高が無視できる程度である場合は、特徴点の絶対座標の算出に対し、車両座標における鉛直方向の座標は無視して算出することができる。
According to such a calculation process, a live-action image and each feature point included therein can be linked with a common absolute coordinate system.
It should be noted that these processes are not necessarily required to be performed for all the acquired frames stored in the video recording means 1, but only if at least the feature points included in the actual video data output to the display frame F are performed. good. For the vehicle coordinates in this example, if the ratio of the vertical coordinate ratio is negligible between an arbitrary acquisition frame and the immediately preceding and subsequent acquisition frames, The vertical coordinate can be calculated by ignoring the coordinate.

また、各特徴点をその絶対座標に基づき絶対座標系に配置する配置手段5dを備えれば、一個の平面的又は立体的な構造物マップを得ることができる。
その際、結合手段5bによれば、数多くの取得フレームに納められた実写映像に含まれる特徴点を、その絶対座標が一致する限りにおいて、同じ特徴点として取り扱うことができ、例えば、車両座標や視線が異なる複数の取得フレームの実写映像に収められた特徴点であっても、共通の絶対座標系に配置することによって、正確な位置関係を持つ一個の立体的な構造物マップを構成することができる。
Further, if the arrangement means 5d for arranging each feature point in the absolute coordinate system based on the absolute coordinates is provided, one planar or three-dimensional structure map can be obtained.
At that time, according to the combining means 5b, the feature points included in the live-action image stored in a number of acquired frames can be handled as the same feature points as long as their absolute coordinates match. Even if the feature points are stored in the live-action video of multiple acquired frames with different lines of sight, they can be arranged in a common absolute coordinate system to form a single three-dimensional structure map with an accurate positional relationship. Can do.

当該例における画像編集手段5cは、特に、車両座標又は適宜入力した指定座標(絶対座標)を中心又はその一部とする一定の領域についての地図画像を出力するものである。
配置手段5dは、実写映像として取得した複数の取得フレームに含まれる特徴点、例えば、各取得フレームにおける車両Aに隠れていない部分に含まれる特徴点を、それらの絶対座標の平面成分に基づき、絶対座標系における二次元の水平面に配置し出力する。
In particular, the image editing means 5c outputs a map image for a certain region centered on or part of the vehicle coordinates or designated coordinates (absolute coordinates) appropriately input.
The arrangement means 5d uses the feature points included in the plurality of acquisition frames acquired as the live-action images, for example, the feature points included in the portions not hidden by the vehicle A in each acquisition frame, based on the plane components of their absolute coordinates, Place and output on a two-dimensional horizontal plane in the absolute coordinate system.

特徴点は、ユーザーにより指定された点や明度又は彩度の相違が大きい点など当該システムの運用に必要な点から任意に抽出することができる。   The feature points can be arbitrarily extracted from points necessary for operation of the system, such as points specified by the user and points having a large difference in brightness or saturation.

前記定義手段5eは、実写映像に含まれる特徴点に属性を与えるものである。例えば、一定の領域若しくは空間を区画し、又は囲む複数の特徴点を構造物の表面を構成する構造物と定義すると共に、それぞれの構造物固有の属性を与えることにより、個々の特徴点が帰属する構造物を明らかにする処理を行うものである。当該例においては、それらの属性固有の属性コードを、取得フレーム各々について、各特徴点の三次元座標と相互に組み合わせた形で保存する。   The definition means 5e gives an attribute to the feature point included in the live-action video. For example, a plurality of feature points that divide or enclose a certain area or space are defined as structures that constitute the surface of the structure, and each feature point is assigned by giving an attribute specific to each structure. The processing to clarify the structure to be performed is performed. In this example, the attribute codes specific to these attributes are stored in a form combined with the three-dimensional coordinates of each feature point for each acquired frame.

属性コードとは、例えば、特徴点単体としては、実写映像を連結するための連結点であり、近接して繋がる特徴点に与えるものにあっては、道路(路肩、縁石、出入り口)等と識別できるコードであり、一定の領域又は空間を囲む複数の特徴点に与えるものにあっては、車両(当該除雪車を含む)、標識、看板、消火栓等を含む各種建造物や設置物等と識別できるコードである。   An attribute code is, for example, a connection point for connecting a live-action video as a single feature point, and is identified as a road (shoulder, curbstone, doorway) etc. A code that can be given to multiple feature points surrounding a certain area or space, and is distinguished from various buildings and installations including vehicles (including the snowplow), signs, signboards, fire hydrants, etc. This is a possible code.

属性には、監視を要する属性(監視属性)も複数存在するが、当該例における除雪支援システムは、車両Aから所定の距離以内に障害物等の監視属性を持つ特徴点が存在する場合にアラーム出力を発する警報手段6を備える。   There are a plurality of attributes that require monitoring (monitoring attributes). However, the snow removal support system in this example provides an alarm when a feature point having a monitoring attribute such as an obstacle exists within a predetermined distance from the vehicle A. The alarm means 6 which emits an output is provided.

当該例における警報手段6は、距離算出手段6aと、判定手段6bを備える。
距離算出手段6aは、前記構造物記録手段5から車両Aの属性を有する特徴点の絶対座標及び各構造物の監視属性を有する特徴点の絶対座標を受け、当該車両Aの属性を有する特徴点と各構造物の監視属性を有する特徴点との間における最少距離を算出する。
判定手段6bは、当該距離算出手段6aが出力した距離を受けて、当該距離が所定の閾値を上回るか下回るか否かを判断し、そのいずれかにおいてアラーム出力を発する。
この様な警報手段6による処理を以って、車両Aと各構造物との上下前後左右における接触や過度な近接が回避できることとなる。
The alarm means 6 in the example includes a distance calculation means 6a and a determination means 6b.
The distance calculation means 6a receives the absolute coordinates of the feature point having the attribute of the vehicle A and the absolute coordinates of the feature point having the monitoring attribute of each structure from the structure recording means 5, and the feature point having the attribute of the vehicle A And the minimum distance between the feature points having the monitoring attribute of each structure.
The determination unit 6b receives the distance output by the distance calculation unit 6a, determines whether the distance exceeds or falls below a predetermined threshold value, and issues an alarm output at either of them.
By such processing by the alarm means 6, contact between the vehicle A and each structure in the up, down, front, back, left, and right directions and excessive proximity can be avoided.

特徴点表示手段5fは、映像出力手段4の処理で映像記録手段1から読み出された実写映像の表示フレームFに、絶対座標を持つ特徴点を、絶対座標を算出した際に得た各取得フレームにおけるピクセル座標に則って配置すると共に、その近傍に当該絶対座標を表示する(図7参照)。   The feature point display means 5f obtains the feature points having absolute coordinates in the display frame F of the live-action video read from the video recording means 1 by the processing of the video output means 4 and obtained when the absolute coordinates are calculated. It arranges according to the pixel coordinates in the frame, and displays the absolute coordinates in the vicinity thereof (see FIG. 7).

上記除雪支援システムにおいては、表示フレームFに、例えば、車両Aの輪郭又は像を挿入することによって、除雪時における車両感覚を実体目視による感覚に近付けることができる点で便宜であり、車両Aの輪郭又は像を表示フレームFから適宜除くことによって、車両Aに隠れた部分の特徴点又は実写映像も含めて道路状況を検証することができる。   In the snow removal support system, for example, by inserting an outline or an image of the vehicle A into the display frame F, for example, the vehicle sense at the time of snow removal can be brought close to a sense by actual visual observation. By appropriately removing the contour or image from the display frame F, the road situation can be verified including the feature points of the part hidden in the vehicle A or the live-action image.

当該例における除雪支援システムにおいては、前記結合手段4cによって、表示フレームFに出力された領域について、実写映像として取得した複数の取得フレームにおいて車両Aその他の構造物に隠れていない部分を重畳的に配置連結することによって車両Aその他の構造物を除く手法を採ることができる(図7(A)参照)。
また、特徴点表示手段5fによって表示された特定の属性を持つ特徴点に囲まれた領域へCG画像を挿入し、又は除く処理を行うこともできる(図7(B)参照)。
In the snow removal support system in this example, the combination unit 4c superimposes a portion that is not hidden by the vehicle A or other structure in a plurality of acquisition frames acquired as a live-action image for the region output to the display frame F. By arranging and connecting, a method of removing the vehicle A and other structures can be taken (see FIG. 7A).
In addition, it is possible to perform processing for inserting or removing a CG image in a region surrounded by feature points having specific attributes displayed by the feature point display means 5f (see FIG. 7B).

当該例における車両Aは、屋根にカメラ及び姿勢センサ1bを搭載すると共に、除雪車として、車両Aの下部に路上の雪をかき集める除雪板Bを車両Aの前方に向けて水平揺動可能に備える(図5(B)及び図6参照)。   The vehicle A in this example has a camera and a posture sensor 1b mounted on the roof, and a snow removal board B that collects snow on the road at the lower part of the vehicle A so as to be able to horizontally swing toward the front of the vehicle A as a snow removal vehicle. (See FIGS. 5B and 6).

当該車両Aは、除雪板Bの左右側方に開閉可能な閉鎖板Cを備える。
当該例は、前記警報手段6が発するアラーム出力に連動して閉鎖板Cを閉じる閉鎖板制御手段7を備える。当該例における閉鎖板制御手段7は、アラーム出力をトリガーとして閉鎖板Cの駆動軸D1を揺動角分だけアクチュエータを正転又は逆転させるものである。
The vehicle A includes a closing plate C that can be opened and closed on the left and right sides of the snow removal plate B.
This example includes a closing plate control means 7 for closing the closing plate C in conjunction with an alarm output generated by the warning means 6. The closing plate control means 7 in this example is to rotate the actuator forward or backward by the amount of the swing angle of the drive shaft D1 of the closing plate C using an alarm output as a trigger.

当該例では、前記アクチュエータとして除雪板Bの上縁に沿って駆動軸D1を回転自在に支持し、当該駆動軸D1から側方に延びたクランクD2を、除雪板Bの上部に揺動可能に支持したシリンダD3で進退させることにより、当該駆動軸D1の回転を促す。当該駆動軸D1の先端部に閉鎖板Cを固定し、当該駆動軸D1の回転を閉鎖板Cが水平方向から垂直方向へ規律するに至る揺動が得られる様に制御することによって、除雪板Bの端部における閉鎖板Cの開閉が可能となる。   In this example, a drive shaft D1 is rotatably supported along the upper edge of the snow removal plate B as the actuator, and a crank D2 extending laterally from the drive shaft D1 is swingable to the upper portion of the snow removal plate B. The drive shaft D1 is urged to rotate by advancing and retreating with the supported cylinder D3. A snow removing board is fixed by fixing a closing plate C to the tip of the driving shaft D1 and controlling the rotation of the driving shaft D1 so that the closing plate C swings from the horizontal direction to the vertical direction. The closing plate C at the end of B can be opened and closed.

例えば、道路の交差点や、道路の出入り口において除雪した雪を排雪放置すれば、当該箇所における人や車両の通行が妨げられることとなるが、出入り口や交差点の始点を示す監視属性データの検出をトリガーとして閉鎖板Cを閉鎖し、終点を示す監視属性データの検出をトリガーとして閉鎖板Cを開放する制御を行えば、道路の交差点や、道路の出入り口において除雪した雪を排出放置することを回避できる。この際、始点検出後、ただちに閉鎖トリガーを発し、終点検出後、所定の遅延時間を経て開放トリガーを発する制御とすることもできる。   For example, if snow removed from a road intersection or road entrance is left undisturbed, traffic of people and vehicles at that location will be hindered, but detection of monitoring attribute data indicating the starting point of the doorway or intersection will be detected. If the control is performed by closing the closing plate C as a trigger and opening the closing plate C using the detection of monitoring attribute data indicating the end point as a trigger, it is possible to avoid leaving the snow removed at road intersections and road entrances. it can. At this time, it is also possible to perform a control in which a closing trigger is issued immediately after the start point is detected, and an opening trigger is issued after a predetermined delay time after the end point is detected.

この様な警報手段6は、路肩や縁石等、雪を放置できない箇所に隣接する構造物の属性(監視属性)を持つ特徴点に対し、出入り口や交差点の始点及び終点を示す監視属性データを予め与えることによって実現できる。
その際、警報手段6は、前記構造物記録手段5から表示フレームFにおける車両Aの属性を有する全ての特徴点、並びに前記始点を示す監視属性を有する特徴点、及び前記終点を示す監視属性を有する特徴点の絶対座標を受けると共に、車両Aの属性を有する全ての特徴点と前記始点及び終点を示す監視属性を有する特徴点のとの間の最短距離及びその方向を導く距離算出手段6aと、当該最短距離の増減又は方向の変化からアラーム出力の要否を決める判定手段6bを備え、排雪禁止区間を避けた位置において確実に閉鎖板Cが開放し、又は閉鎖する様にアラーム出力を発する。
Such alarm means 6 preliminarily stores monitoring attribute data indicating the start and end points of doorways and intersections for feature points having attributes (monitoring attributes) of structures adjacent to places where snow cannot be left, such as shoulders and curbs. It can be realized by giving.
At that time, the alarm means 6 obtains all the feature points having the attribute of the vehicle A in the display frame F from the structure recording means 5, the feature points having the monitoring attribute indicating the start point, and the monitoring attributes indicating the end point. Distance calculating means 6a for receiving the absolute coordinates of the feature points having and having the shortest distance and the direction between all the feature points having the attribute of the vehicle A and the feature points having the monitoring attribute indicating the start point and the end point; The determination means 6b determines whether or not the alarm output is necessary based on the increase / decrease of the shortest distance or the change of the direction, and the alarm output is output so that the closing plate C is reliably opened or closed at a position avoiding the snow removal prohibition section. To emit.

上記警報手段6については、排雪箇所を特定する際の精度を更に高めるべく、実際の路上にICタグを埋設し、当該距離の増減又は方向の変化を検出判定することによりアラーム出力を発する警報手段6を採用しても良い。
その際、警報手段6は、現時点の車両座標を基準として、実際の路上における排雪禁止区間(出入り口又は交差点等)の始点に固定したICタグ及び終点に固定したICタグに至る距離又は方向を導く距離算出手段6aと、当該距離の増減又は方向の変化からアラーム出力の要否を決める判定手段6bを備え、排雪禁止区間を避けた位置において確実に閉鎖板Cが開放し、又は閉鎖する様にアラーム出力を発する。
As for the alarm means 6, in order to further improve the accuracy when specifying a snow discharge location, an IC tag is embedded on an actual road, and an alarm output is generated by detecting and determining an increase or decrease in the distance or a change in direction. The means 6 may be adopted.
At that time, the warning means 6 uses the current vehicle coordinates as a reference to determine the distance or direction to the IC tag fixed at the start point and the IC tag fixed at the end point of the snow removal prohibition section (entrance / intersection or the like) on the actual road. A guiding distance calculating means 6a and a determining means 6b for determining whether or not an alarm output is necessary based on increase / decrease of the distance or a change in direction are provided, and the closing plate C is reliably opened or closed at a position avoiding the snow removal prohibition section. Alarm output.

排雪禁止区間を避けた位置において閉鎖板Cを開放させる為の前記判定手段6bの具体的な判断基準として、例えば、車両Aの属性を有する全ての特徴点と前記始点及び終点を示す監視属性を有する特徴点のとの間の最短距離の双方が各々の閾値以下に減少し、若しくはその方向角の双方が各々の閾値以上に深くなっており、且つ両最短距離の差が始終点間の距離以上である場合、又は車両座標から位置座標の分っている近隣始終点2点に埋設した各ICタグまでの距離の双方が各々の閾値以下に減少し、若しくは方向角双方が各々の閾値以上に深くなっており、且つ両最短距離の差が始終点間の距離以上である場合には、車両Aが出入り口又は交差点に十分に接近したと推測できるので、この時に閉鎖板Cが閉鎖するようにアラーム出力を発する様にすれば良い。   As specific determination criteria of the determination means 6b for opening the closing plate C at a position avoiding the snow-breaking prohibition section, for example, all the characteristic points having the attribute of the vehicle A and the monitoring attributes indicating the start point and the end point Both of the shortest distances between the feature points having the distances are reduced below the respective thresholds, or both the direction angles thereof are deeper than the respective thresholds, and the difference between the shortest distances is between the start and end points. If the distance is greater than the distance, or both the distance from the vehicle coordinates to the IC tags embedded in the two neighboring start and end points where the position coordinates are known, both decrease below the respective threshold values, or both the direction angles are the respective threshold values. If it is deeper than this and the difference between the shortest distances is greater than or equal to the distance between the start and end points, it can be assumed that the vehicle A has sufficiently approached the doorway or intersection, so the closing plate C is closed at this time. So that the alarm output It may be as to.

更に、例えば、車両Aの属性を有する全ての特徴点と前記始点及び終点を示す監視属性を有する特徴点のとの間の最短距離の双方が各々の閾値以上に増加し、若しくはその方向角の双方が各々の閾値より浅くなっている時、又は車両座標から位置座標の分っている近隣始終点2点に埋設した各ICタグまでの距離の双方が各々の閾値以上に増加し、若しくは方向角双方が各々の閾値より浅くなっている時には、車両Aが出入り口又は交差点を避けた位置に存在すると推測できるので、この時にのみ閉鎖板Cが開放するようにアラーム出力を発する様にすれば良い。   Furthermore, for example, both of the shortest distances between all feature points having the attribute of the vehicle A and the feature points having the monitoring attribute indicating the start point and the end point are increased by more than the respective threshold values, or When both are shallower than their respective thresholds, or both the distances from the vehicle coordinates to each IC tag embedded in two neighboring start and end points whose position coordinates are known, both increase beyond the respective thresholds, or directions When both corners are shallower than the respective threshold values, it can be estimated that the vehicle A exists at a position avoiding the doorway or the intersection. Therefore, it is only necessary to issue an alarm output so that the closing plate C is opened only at this time. .

1 映像記録手段,1a 撮像手段(CCD),1b 姿勢センサ,
2 車両座標検出手段,2a 加速度センサ,
3 移動方向検出手段,
4 映像出力手段,4a 映像編集手段,4b 視線解析手段,4c 結合手段,
5 構造物記録手段,
5a 座標算出手段,5b 結合手段,5c 画像編集手段,5d 配置手段,
5e 定義手段,5f 特徴点表示手段,
6 警報手段,6a 距離算出手段,6b 判定手段,
7 閉鎖板制御手段,
A 車両,B 除雪板,C 閉鎖板,
D1 駆動軸,D2 クランク,D3 シリンダ,
F 表示フレーム,
L 長さ,θ1,θ2 角度
1 video recording means, 1a imaging means (CCD), 1b attitude sensor,
2 vehicle coordinate detection means, 2a acceleration sensor,
3 moving direction detection means,
4 video output means, 4a video editing means, 4b line-of-sight analysis means, 4c coupling means,
5 Structure recording means,
5a coordinate calculating means, 5b combining means, 5c image editing means, 5d arranging means,
5e definition means, 5f feature point display means,
6 alarm means, 6a distance calculation means, 6b determination means,
7 Closing plate control means,
A vehicle, B snow removal board, C closure board,
D1 drive shaft, D2 crank, D3 cylinder,
F display frame,
L length, θ1, θ2 angle

Claims (9)

無積雪時に撮像手段(1a)で同時取得した全方位の実写映像を、映像取得時の車両(A)の絶対座標系における車両座標、移動方向、及び撮像手段(1a)の姿勢情報と結び付けて記録する映像記録手段(1)と、
現時点の車両(A)の絶対座標系における車両座標を取得する車両座標検出手段(2)と、
現時点の車両(A)の絶対座標系における移動方向を導く移動方向検出手段(3)、
現時点の車両(A)の絶対座標系における車両座標並びに所望の視線から導かれる移動方向及び姿勢情報に対応する実写映像を、前記映像記録手段(1)から読み出し表示フレーム(F)に出力する映像出力手段(4)と、
当該映像出力手段(4)が前記映像記録手段(1)から読み出した実写映像に含まれる特徴点の絶対座標系における位置座標を導き保存する構造物記録手段(5)を備えることを特徴とする除雪支援システム。
The omnidirectional live action image simultaneously acquired by the image pickup means (1a) when there is no snow is combined with the vehicle coordinates, the moving direction, and the attitude information of the image pickup means (1a) in the absolute coordinate system of the vehicle (A) at the time of image acquisition. Video recording means (1) for recording;
Vehicle coordinate detection means (2) for acquiring vehicle coordinates in the absolute coordinate system of the current vehicle (A);
A moving direction detecting means (3) for deriving a moving direction in the absolute coordinate system of the current vehicle (A),
A video that is read out from the video recording means (1) and output to a display frame (F) corresponding to the vehicle coordinates in the absolute coordinate system of the current vehicle (A) and the moving direction and posture information derived from the desired line of sight. Output means (4);
The video output means (4) comprises structure recording means (5) for deriving and storing the position coordinates of the feature points included in the actual video read from the video recording means (1) in the absolute coordinate system. Snow removal support system.
映像出力手段(4)が映像記録手段(1)から読み出した実写映像の表示フレーム(F)において、絶対座標を導いた特徴点をマーキングすると共に、その近傍に当該絶対座標を表示する特徴点表示手段5fを備える前記請求項1に記載の除雪支援システム。   In the display frame (F) of the live-action video read out from the video recording means (1) by the video output means (4), the feature point that leads to the absolute coordinates is marked, and the feature point display that displays the absolute coordinates in the vicinity thereof The snow removal support system according to claim 1, further comprising means 5f. 前記構造物記録手段(5)は、実写映像に含まれる構造物の特徴点に対する二つの撮影点を結ぶ線分の長さ(L)を導くと共に、当該線分と各撮影点から各々当該特徴点を結ぶ線分が成す角度(θ1,θ2)を導き、前方交会法の演算処理によって特徴点の絶対座標系における位置座標を導く座標算出手段(5a)を備え、
当該座標算出手段(5a)は、当該特徴点を撮影した時点の車両(A)の絶対座標系における車両座標を撮影点とし、
前記角度(θ1,θ2)を、当該特徴点を含む取得フレームを撮影した時点の車両(A)の絶対座標系における車両座標、移動方向、及び撮像手段(1a)の姿勢情報、並びに当該特徴点を含む取得フレームのピクセル座標から算出することを特徴とする前記請求項1又は請求項2のいずれかに記載の除雪支援システム。
The structure recording means (5) derives the length (L) of the line segment connecting the two shooting points with respect to the feature points of the structure included in the live-action image, and the feature from the line segment and each shooting point. Coordinate calculation means (5a) for deriving angles (θ1, θ2) formed by line segments connecting the points and deriving position coordinates in the absolute coordinate system of the feature points by calculation processing of the forward intersection method,
The coordinate calculation means (5a) uses the vehicle coordinates in the absolute coordinate system of the vehicle (A) at the time of shooting the feature point as a shooting point,
The angles (θ1, θ2), vehicle coordinates in the absolute coordinate system of the vehicle (A) at the time of capturing the acquisition frame including the feature points, the moving direction, the posture information of the imaging means (1a), and the feature points The snow removal support system according to claim 1, wherein the snow removal support system is calculated from pixel coordinates of an acquisition frame including
前記映像出力手段(4)は、車両座標又は指定座標を含む一定の領域の地図映像を出力する映像編集手段(4a)を備え、
当該映像編集手段(4a)は、取得した実写映像の複数の取得フレームに含まれる平面映像を連結する結合手段(4c)を備えることを特徴とする前記請求項1乃至請求項3のいずれかに記載の除雪支援システム。
The video output means (4) includes video editing means (4a) for outputting a map video of a certain area including vehicle coordinates or designated coordinates,
The said video editing means (4a) is provided with the coupling | bonding means (4c) which connects the plane image contained in the some acquisition frame of the acquired real image | video, The said any one of Claim 1 thru | or 3 characterized by the above-mentioned. The snow removal support system described.
前記構造物記録手段(5)は、車両座標又は指定座標を含む一定の領域についての地図画像を出力する画像編集手段(5c)を備え、
当該画像編集手段(5c)は、取得した実写映像の複数の取得フレームに含まれる特徴点を絶対座標系における二次元の水平面に配置する配置手段(5d)を備えることを特徴とする前記請求項1乃至請求項4のいずれかに記載の除雪支援システム。
The structure recording means (5) includes image editing means (5c) for outputting a map image for a certain region including vehicle coordinates or designated coordinates,
The said image editing means (5c) is provided with the arrangement | positioning means (5d) which arrange | positions the feature point contained in the several acquisition frame of the acquired real image | video on the two-dimensional horizontal surface in an absolute coordinate system, The said claim | item 5 characterized by the above-mentioned. The snow removal support system according to any one of claims 1 to 4.
前記特徴点に属性を与える定義手段(5e)を備える前記請求項1乃至請求項5のいずれかに記載の除雪支援システム。   The snow removal support system according to any one of claims 1 to 5, further comprising definition means (5e) for assigning an attribute to the feature point. 監視対象となる特徴点に監視属性を与える定義手段(5e)と、
車両(A)の属性を持つ特徴点と監視属性を有する特徴点との距離を各々の絶対座標系における位置座標より導く距離算出手段(6a)と、
車両(A)の属性を持つ特徴点と監視属性を有する特徴点との距離が所定の距離以内である場合にアラーム出力を発する警報手段(6)を備えることを特徴とする前記請求項6に記載の除雪支援システム。
Definition means (5e) for assigning a monitoring attribute to a feature point to be monitored;
Distance calculating means (6a) for deriving the distance between the feature point having the attribute of the vehicle (A) and the feature point having the monitoring attribute from the position coordinates in each absolute coordinate system;
The apparatus according to claim 6, further comprising alarm means (6) for generating an alarm output when the distance between the feature point having the attribute of the vehicle (A) and the feature point having the monitoring attribute is within a predetermined distance. The snow removal support system described.
現時点の車両座標を基準として、実際の路上における排雪禁止区間の始点に固定したICタグ及び終点に固定したICタグに至る距離又は各ICタグへの方向を導く距離算出手段(6a)と、
当該距離の増減又は方向の変化を検出し排雪禁止区間でアラーム出力を発する警報手段(7)を備えることを特徴とする前記請求項1乃至請求項7のいずれかに記載の除雪支援システム。
Distance calculation means (6a) for guiding the distance to the IC tag fixed to the start point and the IC tag fixed to the end point of the snow removal prohibition section on the actual road with reference to the current vehicle coordinates, or the direction to each IC tag,
The snow removal support system according to any one of claims 1 to 7, further comprising alarm means (7) for detecting an increase or decrease in the distance or a change in direction and issuing an alarm output in a snow removal prohibition section.
前記請求項7又は請求項8のいずれかに記載の除雪支援システムと、
路上の雪を掻き集める除雪板(B)と、
当該除雪板(B)の対雪面に沿って側方へ流れる雪の排雪を止める開閉可能な閉鎖板(C)と、
前記警報手段(6)が発するアラーム出力を受けて閉鎖板(C)を開閉する開閉板制御手段(7)を備えることを特徴とする除雪車。

A snow removal support system according to any one of claims 7 and 8;
A snow removal board (B) that collects snow on the road;
An openable / closable closing plate (C) for stopping the snow drainage of the snow flowing sideways along the surface of the snow removal plate (B) against the snow;
A snowplow comprising an opening / closing plate control means (7) for opening and closing the closing plate (C) in response to an alarm output from the warning means (6).

JP2011170087A 2011-08-03 2011-08-03 Snow removal support system and snow removal vehicle Withdrawn JP2013033426A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2011170087A JP2013033426A (en) 2011-08-03 2011-08-03 Snow removal support system and snow removal vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2011170087A JP2013033426A (en) 2011-08-03 2011-08-03 Snow removal support system and snow removal vehicle

Publications (1)

Publication Number Publication Date
JP2013033426A true JP2013033426A (en) 2013-02-14

Family

ID=47789257

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2011170087A Withdrawn JP2013033426A (en) 2011-08-03 2011-08-03 Snow removal support system and snow removal vehicle

Country Status (1)

Country Link
JP (1) JP2013033426A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018204409A (en) * 2017-06-09 2018-12-27 株式会社小松製作所 Work vehicle
JP2018204410A (en) * 2017-06-09 2018-12-27 株式会社小松製作所 Work vehicle
WO2019186813A1 (en) * 2018-03-28 2019-10-03 本田技研工業株式会社 Snow plow; projection method, program, and storage medium for snow plow; and projection system
EP3633107B1 (en) 2018-10-05 2022-03-30 Kässbohrer Geländefahrzeug AG Ski trail maintenance vehicle and method for operating same
JP7076114B1 (en) 2021-05-14 2022-05-27 学校法人 芝浦工業大学 Work support system and work support method
JP2022176119A (en) * 2021-05-14 2022-11-25 学校法人 芝浦工業大学 Work support system and work support method

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018204409A (en) * 2017-06-09 2018-12-27 株式会社小松製作所 Work vehicle
JP2018204410A (en) * 2017-06-09 2018-12-27 株式会社小松製作所 Work vehicle
WO2019186813A1 (en) * 2018-03-28 2019-10-03 本田技研工業株式会社 Snow plow; projection method, program, and storage medium for snow plow; and projection system
US11351864B2 (en) 2018-03-28 2022-06-07 Honda Motor Co., Ltd. Snowplow, projection method for snowplow, storage medium, and projection system
EP3633107B1 (en) 2018-10-05 2022-03-30 Kässbohrer Geländefahrzeug AG Ski trail maintenance vehicle and method for operating same
US11970828B2 (en) 2018-10-05 2024-04-30 Kässbohrer Geländefahrzeug AG Method for operating a piste grooming vehicle
JP7076114B1 (en) 2021-05-14 2022-05-27 学校法人 芝浦工業大学 Work support system and work support method
JP2022176119A (en) * 2021-05-14 2022-11-25 学校法人 芝浦工業大学 Work support system and work support method
JP2022175988A (en) * 2021-05-14 2022-11-25 学校法人 芝浦工業大学 Work support system and work support method
JP7244036B2 (en) 2021-05-14 2023-03-22 学校法人 芝浦工業大学 Work support system and work support method

Similar Documents

Publication Publication Date Title
JP5198835B2 (en) Method and system for presenting video images
EP2261604B1 (en) Computer arrangement for and method of calculating motion vectors using range sensor data
JP5435306B2 (en) Image processing system and positioning system
JP5901779B2 (en) How to move data from image database map service into assist system
JP5682060B2 (en) Image composition apparatus, image composition program, and image composition system
JP4895313B2 (en) Navigation apparatus and method
US9418556B2 (en) Apparatus and method for displaying a blind spot
JP2005268847A (en) Image generating apparatus, image generating method, and image generating program
JP5714940B2 (en) Moving body position measuring device
JP2013033426A (en) Snow removal support system and snow removal vehicle
CN106462727A (en) Systems and methods for lane end recognition
US11280630B2 (en) Updating map data
KR101700681B1 (en) Method and Apparatus for image information of car navigation to Improve the accuracy of the location using space information
CN107966158B (en) Navigation system and method for indoor parking lot
EP3530521B1 (en) Driver assistance method and apparatus
KR102260975B1 (en) Apparatus and method for controlling automatic driving using 3d grid map
US11025865B1 (en) Contextual visual dataspaces
JP7232287B2 (en) ship navigation system
JP5182594B2 (en) Image processing system
US10996469B2 (en) Method and apparatus for providing driving information of vehicle, and recording medium
CN112036210A (en) Method and device for detecting obstacle, storage medium and mobile robot
JP2011170599A (en) Outdoor structure measuring instrument and outdoor structure measuring method
KR20200043252A (en) Overlooking image generation system of vehicle and method thereof
KR20180042242A (en) Method for displaying an object on a three-dimensional model
KR100550430B1 (en) Apparatus and method for guiding route of vehicle using three-dimensional information

Legal Events

Date Code Title Description
A300 Withdrawal of application because of no request for examination

Free format text: JAPANESE INTERMEDIATE CODE: A300

Effective date: 20141007