So this work says that it handles data irrespective of whether annotations are there or not.

If I want to guide line detection with the annotations(I mean handmade annotations not the pseudo annotations which SOLD2 generates), is that possible ?

May be the algorithm is tuned for wireframe and may not work for aerial images.