Information technology for video monitoring of terrain with objects on it with determination of three-dimensional coordinates of objects

Purpose. for the use of unmanned aerial vehicles for remote sensing from the air of territories, buildings and equipment (for example, in emergency response areas); search, detection and identification of objects in a given area or route strip with determination of their coordinates, as well as for monitoring detected objects with the subsequent transmission of photo or video information in real time. The purpose of the developed information technology is to obtain a three-dimensional image of a dynamic scene, with moving objects located on it, stationary and non-stationary, with the ability to calculate the three-dimensional coordinates of these scene objects.

Specifications. The onboard equipment of the UAV used for video monitoring includes video or multispectral cameras installed on the onboard platform of the UAV and spaced apart from each other in a plane perpendicular to the direction of movement at a fixed distance, calculated taking into account the required accuracy of calculating the current three-dimensional coordinates of the recorded objects. 2. Image processing is performed by specially developed computer programs using the OpenCV open source computer vision library.

Application area. Research and experimental developments in the field of natural and technical sciences.

Advantages. The proposed uniqueness of information technology lies in the fact that for the first time a well-founded systematic approach to the problem of tracking the consequences of a technical incident in real time is proposed (in the presence, in particular, of fleeting processes of damage to infrastructure, transport routes, etc.) with the ability to obtain information about three-dimensional coordinates and prompt correction area maps.

Description. Sequencing. The UAV is launched, video monitoring of the area is performed according to a given work program, the video material received promptly from two synchronously operating video cameras on the UAV is studied in accordance with the task; use a mouse or other pointer to designate potential targets on survey materials and identify informative frames. Based on the position of the image of the monitoring object on the ground in the frame, the coordinates and orientation angles of the UAV video cameras, the three-dimensional coordinates of the object indicated by the operator on the video frames are calculated in real time, for which computer processing of the selected pairs of frames is performed using stereo programs; based on the results of stereo processing of the parameters of the three-dimensional scene of the area being surveyed, the area map is corrected taking into account the identified changes; if necessary, organize repeated video monitoring of the area along the new reconnaissance route with the recommended ground control point for the updated speed and altitude of the UAV.

More details…