Knowledge Co-Creation Program (JFY2023)

LANDSLIDE COUNTERMEASURE WORKS FOR TRUNK ROADS

Image analysis method

using Metashape

Osamu Yokoyama
 Contents

１． Procedure to create Creation of three-dimensional terrain model

２． Operating method of Metashape
1. Steps to create 3D models

3
Aerial photography using UAV (Unmanned Aerial Vehicle) / Drone
 Obtaining vertical photographs of the target area using UAV
 Exercise using aerial photographs of the landslide taken in Japan

4
 Aerial photography using UAV
 It is efficient to take aerial photographs based on the flight plan using an automated navigation system.
 UAV automated navigation software includes DJI GS PRO (free version / charge version) and Litchi
(charged).

5
Mission Hub https://flylitchi.com/hub
 Procedure of the image analysis

Lecture 2 Image processing Lecture 1 Geographic information

software/Metashape system (GIS)

①Aligning the aerial photographs DEM Cross sections

（ SfM ）

Contour lines
②Setting the ground control
points (GCP)
Topographic
map
③Building of the dense point cloud
(MVS: Multiple Virtual Storage)
Finite difference Ortho image
④Building of the grid mesh (TIN: analysis diagram
Triangulated Irregular Network)
Planar map
Superposition

⑤Ortho image ⑥DEM

Previous DEM

6
 Image analysis ① Alignment of the aerial photographs
What is SfM (Structure from Motion) processing?
 Technology / processing that simultaneously reconstitutes the three-dimensional shape of an object and
the photographing positions from multiple photographs taken while viewpoint of the camera is changing.

Aerial photography from UAV

Photographing position

7
 Image analysis ② Setting the ground control points (GCP)
What is GCP (Ground Control Point)
 Points required to add positional information to three-dimensional point cloud dataset.
 Coordinates are measured by total station or GNSS.

GNSS surveying
Example of installation of GCPs

8
 Image analysis ③ Dense point cloud building
What is dense point cloud processing? （ MVS ： Multi View Stereo ）
 A technology / process that creates a higher-density point cloud from a sparse point cloud extracted by SfM
processing and reconstitutes a more precise three-dimensional shape.

SfM processing MVS processing

Low density point cloud Dense point cloud

9
 Image analysis ④ Building of grid mesh (TIN)
What is TIN (Triangulated Irregular Network)?
 An aggregation of triangles composed of randomly arranged point clouds connected by any three
points.
 By converting high-density point clouds to TIN, visualization of three-dimensional shapes will be
possible.

10
 Image analysis ⑤ Exporting ortho images
What is the ortho images?
 Aerial photographs taken with the aerial camera, etc., that have been converted into images that is
displayed in the correct size and position without distortion.

Aerial photo Ortho image

Central projection Orthographic projection

11
 Image analysis ⑥ Exporting DEM
What is DEM?
 Data in which the ground surface is divided into squares at
equal intervals and each square has an elevation value of the
center point.

• DSM ： Digital Surface Model

• DEM ： Digital Elevation Model

国土地理院 https://www.gsi.go.jp/kankyochiri/Laser_senmon.html

12
2. How to operate Agisoft Metashape?

13
 What is Agisoft Metashape?
 Agisoft Metashape is a software product that performs photogrammetric processing of digital images
taken from airplane or UAV, and generates 3D spatial data such as DEM, orthomosaic images, or
bird’s-eye view images.
 The products include, Standard version and Professional version, and Professional version is required
to generate DEM and orthomosaic images.
 You can download the latest version of Metashape from the website. You can use all functions on a trial
mode within 30 days of installation.
Functions Standard Professional Functions Standard Professional

Building and export of the point cloud ○ ○ Building and export of orthomosaic image － ○
Building and export of the 3D model Generation of processing report － ○
○ ○
(mesh)
Processing of multispectral images － ○
Building and export of the 3D model ○ ○
Support for Python scripting － ○
Pasting textures ○ ○
Network processing － ○
Batch processing ○ ○
Agisoft Viewer － ○
Merging ○ ○
Display of orthomosaic images, DEM /
－ ○
Import of video ○ ○ DSM
Import of dense cloud ○ ○ Building and export of contour lines － ○
Importing positional coordinates － ○ Raster Transform － ○
Setting and change of coordinate Conversion of reflectivity － ○
－ ○
system
Cloud processing － ○
Classification procedure of point cloud － ○ 14
 Download of Agisoft Metashape
 Download Agisoft Metashape 2.0.2 from the following URL. （ 2023/7/1 ）
https://www.agisoft.com/downloads/installer/
 Refer to the tutorial or download the user manual, if required.
 The installer and the User Manual are in included the distributed data.
 The system requirements are as follows.
Basic Configuration Advanced Configuration

up to 32 GB RAM up to 128 GB RAM

CPU: 4 - 8 core Intel or AMD processor, CPU: 6 - 24 core Intel or AMD processor,
2.0+ GHz 3.0+ GHz

RAM: 16 - 32 GB RAM: 32 - 128 GB

GPU: NVIDIA or AMD GPU with 700+ GPU: 1 - 2 NVIDIA or AMD GPUs with
CUDA cores / shader processor units (For 1920+ CUDA cores / shader processor units
example: GeForce GTX 1080 or Radeon RX (For example: GeForce RTX 2080 Ti or
5700) Radeon VII)
15
 Download of Agisoft Metashape
 Install Agisoft Metashape.

① ② ③ Check ④

Waiting…
⑤ ⑥

16
 Activation of Metashape
 Activate Metashape.
 The professional version of Metashape is free for up to 30 days in full-function mode.
The number of days left is displayed (30-day trial and demo mode)

The license code shall be input correctly for

the full function mode.

Check

Demo
ver. ①

17
 Initial settings
GUI language or theme can be changed with following procedure.
【 Tools 】→【 Preferences 】→【 General 】→【 User Interface 】
Three types of themes are available.

Setting
③

Dark
In this lecture, Theme is
Classic.
Light

②
④ Classic
18
 Saving of project files
 Return function is not provided with Metashape.
 It is recommended to save the project (*.psx) at each stage.
 Because many files are created in the process.
Saving projects

Save File

② Ex:Testsite.psx

***.psx

19
 Operation 1: Loading of Images
 Load images taken from UAV.
A ：【 Workflow 】→【 Add photos... 】→【 Select photographs 】→【 Open 】
B ：【 Add Folder... 】→【 Folder selection 】
C ： Drag and drop
A

① ②Select

③Click A list of added photos is displayed.

20
 Operation 2: Confirmation of geographic coordinate system
 UAVs (Phantom, MAVIC, etc.) are equipped with GPS, and the geographic coordinates (latitude /
longitude) of the photographing position are added to the pictures taken.
 Confirm that the coordinate system of the project is the geographic coordinate system [WGS84 (EPSG:
4326)]. If the corresponding option is not included in
the pull-down menu, select "More"

③
WGS 84 (EPSG:4326)

Choose a desired
coordinate
system.

Reference
① 21
 Operation 3: Searching of feature points (SfM processing)
 SfM : Structure from Motion
 Technology to reconstruct the shape of objects from multiple photographs of the objects
 Specify the photographing position of the photograph to extract the characteristic point cloud of the
objects.
 The number of point clouds to be generated and the processing time will differ depending on the setting
of "Accuracy".

High or Low
Few
minutes
later

Input [0] for both

10,398 points
Change them if error occurs
The points generated on my PC and the time it took
High ： 196,908 point → 100
seconds
Low : 10,398 point → 15 seconds22
 What is feature point?

豆知識①
 Key points
Points on the image that can be detected clearly.
 Tie points
Points for connecting photos between adjacent photographing courses
Key points
タイポイント

23
 Result of alignment
 Camera positions in the Model view can be displayed.
 The point cloud in the Model view can be checked from any direction by operating the mouse.

Mouse scroll wheel: zoom in/out

Dragging the left mouse button: rotate trackball
Dragging the right mouse button: move trackball

Camera position and file name

Trackball

24
 Operation 4 ： Edit processing region
 The region shall be adjusted so that the loaded point cloud model fits within the processing region.
 The bounding box can be adjusted using the Resize Region, Move Region and Rotate Region toolbar
buttons.
Adjust the rectangle so
that the point cloud is
Resize is adjusted with the corner of the area included in the region

Point cloud not being

included in the region

Processing region

Area that is not needed

25
 Operation 5: Removal of unwanted photos
 To shorten the processing time, unnecessary photos shall be removed such as ones
taken during takeoff and landing, or moving between flight lines.

Right-click menu
Example: Before
Moving to the first
Moving from the flight line waypoint
to next flight line

Select photographs,
then right-click to
display the menu

Takeoff and
landing

26
 Advantages and disadvantages to install GCPs
Option Operation Advantage Disadvantage
A ： GCPs are installed • Install several beacons,
→Match the coordinates of then obtain the
• Discordance between
GCPs measured on the coordinates of them by
the terrain model and • Accurate surveying is
site with the terrain model surveying.
the actual terrain is little. required.
• Set new markers on
• Accuracy of the terrain • The procedure is
Metashape.
model is a few complicated.
• Remove the
centimeters.
coordinates attached to
the UAV photographs.
B ： GCPs are not • Compared to the case
installed where GCPs are
installed, the accuracy
→The terrain model is built of the terrain model is
• The procedure is
only with the positional • Not specified. reduced, so the model
simplified.
information added to the discords with the actual
UAV aerial photographs. terrain.
• Accuracy of the terrain
model is a few meters.

In the training on July 6 and 21, Case B "Where GCPs are not installed" will be guided. Case A will be explanation only.
27
 If antiaircraft
Operation 6: Placement of markers ※Explanation only on July 6 and 21 training beacons are
installed

 The accurate terrain model can be built by installing multiple antiaircraft beacons (GCPs) with positional
coordinates to correct the model.
 GCPs are also used to verify the accuracy of the model as "check points".
 Place markers in the center of the GCPs on the aerial photographs where the GCPs were taken.

Magnify

Right-click at the center.

Right-click
Double-click the thumbnail of
the photograph with the
antiaircraft beacons to display it.

Rename

Name of the antiaircraft beacon,

etc. (Example: GCP1 etc.)

The marker will be placed.

28
 If antiaircraft
Operation 6: Placement of markers ※Explanation only on July 6 and 21 training
beacons are
installed
 The list of placed markers is displayed in the workspace.
 If the markers are not displayed, select [Workspace] from [View] on the toolbar to display them.

Selected pane will be

displayed on the screen.

Switch them with tab.

29
 ※Explanation only on July 6 If antiaircraft
Operation 7: Adjusting marker locations and 21 training beacons are
installed

 Display the photograph with the markers to adjust the marker locations.
 Remove the marker if it cannot be identified nor be recognized due to obstacles.

Right-click on the marker

Flag will be displayed when there is a marker.

Pick up the photograph with markers, then they

will be placed automatically on the photograph.

Green flag: Location is adjusted

Blue flag: Location is not adjusted
→Location shall be adjusted

【 If discordance exists. 】 【 If the center cannot be recognized 】

The flag will change to black and folded.

Center

Right-click the marker 30

Drag the marker to the center Remove the marker
 If antiaircraft
Example of placement of GCPs ※Explanation only on July 6 and 21 training beacons are
installed

31
 If antiaircraft
Operation 8: Setting of the coordinate system ※Explanation only on July 6
and 21 training beacons are
installed

 Input the coordinates data for each marker.

 Coordinate system of the project should be same as that of the markers.
 Search becomes possible by inputting the EPSG code.
Geographical coordinates: WGS 84 (EPSG:4326)
Click the Settings icon in the toolbar of the Set the coordinates system
Reference pane.
Select the proper coordinate system from the pulldown menu.
Click “More…” if proper coordinate system is not included.
Search with EPSG code

0.05

32
 ※Explanation only on July 6 If antiaircraft
Operation 9: Input of the coordinate system and 21 training beacons are
installed
 Input the measured coordinate system (Longitude, Latitude, Altitude).

①Double-click the marker, then input coordinates data.

#Label X/ Longitude Y/ Latitude Z/ Altitude
point 1 138.282374 35.215652 1252.901334
【 Coordinates data obtained with GNSS etc. 】 point 2 138.280269 35.217109 1400.584644
point 3 138.281687 35.218548 1327.755424
point 4 138.283519 35.218404 1210.006527
point 5 138.283567 35.216657 1164.180965 33
point 6 138.285205 35.217888 1089.247741
 ※Explanation only on July 6 If antiaircraft
Operation 10: Removing camera coordinates and 21 training beacons are
installed
 If GCPs are installed, the coordinate information attached to the photographs shall be removed.

②Right-click

④Check “Location”
①Select all images

⑤Check “Rotation”

⑥Click “OK”

③Select “Clear…”. 34
 ※Explanation only on July 6 If antiaircraft
Operation 11: Error estimate with check point and 21 training beacons are
installed
 GCPs shall be installed to cover the object area to be photographed.
 Select some GCPs located inside the object area as check points to confirm the accuracy.
Checked points → control points
Control Unchecked points → check points
point

Check point

Check
point
Point5 & 6 are selected as check points.

If there are any markers with an

extremely large error, uncheck them
and optimize again.
If the error is still large, review the
marker location or input data.

Check the error after alignment is processed. 35

The error should be less than 10 cm.
 Operation 12: Removing unnecessary point clouds
 Sometimes, unnecessary point clouds may be generated behind, below, or in the air of the 3D model.
 Such unnecessary points cloud shall be removed manually.

③Enclose unnecessary point clouds

①Select the shape of points to be removed

④Remove with “Delete” key

②Click Selection tool icon

Deselect with “Esc” key

36
 Operation 13: Optimization of camera alignment
 If installation of markers or removal of point clouds has been performed after SfM, the camera
alignment is to be optimized.
 The camera location, camera orientation angles, or image distortion will be re-estimated by the
optimization.

Click Stick icon

Items that can be optimized will

be automatically checked.

37
 Operation 14: Creation of dense point clouds (MVS processing)
 Point clouds are built at high density by MVS to create a precise 3D model.

①Click “Workflow”
③Select “High” or “Low”

Before the dense cloud are built

②Click on “Build Dense Cloud…”
④Select “Mild”

⑥Click “OK”

⑤Check “Calculate point colors”

※ Estimated analysis time General Quality

High:150 seconds
Medium:40 seconds
Low:15 seconds After the dense cloud are built

21,260,079 points 38
 Operation 15: Building mesh (Converting to TIN)
Product
version only

 Build mesh from the generated dense point clouds and build 3D model.
③Select “Dense cloud” Before the mesh is built
①Click “Workflow”
④Select “Height Field”

②Click “Build Mesh…”

⑤Select “High” or “Low”

After the mesh is built

⑦Click “OK”

⑥Check “Calculate vertex colors” ※Estimated analysis time Face count

High: 55 seconds
Medium: 30 seconds
Low: 20 seconds 39
 Product
Operation 16: Building DSM version only

 Convert the created 3D model (TIN) to DEM (Digital Elevation Model).

①Click “Workflow”
③Check “Geographic”

④Select “WGS84 (EPSG: 4326)” as the coordinate

system.

⑤Select “Mesh”
②Click “Build DEM…” Built TIN

⑥Select “Enabled (default)

※DSM will be built, though the

button is "Build DEM…" Minimum value (editing is not required)

⑦Click “OK” Built DSM (DEM)

40
 Product
Operation 17: Building Orthoimage version only

 Build the orthomosaic image based on the created 3D model.

③ Check “Geographic”
①Click “Workflow”

④Select “DEM”

②Click “Build
orthomosaic…”

Minimum value (no editing

required)

Built Orthomosaic

⑤Click “OK” 41
 Exporting Orthoimage and DEM
 Export the Orthoimage and DEM for the coming Lecture 1 and other.
 Convert the coordinate system for the exporting.
■GIS software
■Metashae UTM system (projected coordinate system)

Geographical coordinates (Longitude / Latitude) Orthoimage

Convert coordinate system
・ Coordinates added to UAV aerial photographs
then export.
・ Created terrain model DEM

Earth

Projection plane Map of the projected coordinate system

https://www.esrij.com/gis-guide/coordinate-and-spatial/coordinate-system/
42
Projected coordinate system in the test site of Japan
 Projection coordinate system in test site of Japan ： 2 types
→ ① JGD2011 / Japan Plane Rectangular CS VII (EPSG:6675)
→ ② JGD2011 / UTM zone 53N (EPSG:6690)

Plane rectangular coordinate system

and UTM system

Zone 53

https://www.esrij.com/gis-guide/coordinate-and-spatial/coordinate-system-japan/ 43
Coordinate system in Ethiopia
 Projection coordinate system in center of Ethiopia ：
WGS84/UTM zone 37 (EPSG:32637)

44
https://www.researchgate.net/post/Best_projection_for_calculating_3D_surfaces_in_ArcGIS
 Product
Operation 18: Exporting orthoimage version only

 Export the orthoimages in TIFF format or JPG format

 Also export them in world files (files with positional information) to process with GIS.
⑤Select “JGD2011 / UTMzone53N
①Click “File” (EPSG: 6690)”

0.1~0.5
⑥Input simple number
②Click “Export”

④Click “Export JPEG / TIFF /

PNG...” ⑦Select “White”

③Click “Export
Orthomosaic”

⑧Check "Write World file"

⑩Save as TIFF /
Check to select
GeoTIFF file (* .tif)
transparent background
45
⑨Click “Export”
 Product
Operation 19: Exporting DEM version only

 Export DEM as raster data such as TIFF format or JPG format.

 Also export them in world files (files with positional information) to process with GIS.
⑤Select JGD2011 / UTMzone53N
①Click “File” (EPSG: 6690)

0.03
②Click “Export” ⑥Input simple number

④Click “Export TIF / BIL

/ XYZ ...” ⑦ Input “-99999”
③Click “Export DEM”

⑧Check "Write World file"

⑩Save as TIFF /
GeoTIFF file (* .tif)

⑨Click “Export” 46
 Product
Operation 13: Generating report version only

 Generate Agisoft Metashape processing report in PDF.

 The accuracy and parameters are described.
①Click “File”

②Click “Export”

③Click “Generate ④Input the title

Report…”

Part of the output report

⑤ Click “OK” 47