Yuan 2022 Spatial
Yuan 2022 Spatial
8, AUGUST 2022 1
Abstract—Distributed Acoustic Sensing (DAS) that transforms Our work addresses these problems by leveraging an
city-wide fiber-optic cables into a large-scale strain sensing array emerging fiber-optic sensing technology called DAS. This
has shown the potential to revolutionize urban traffic monitor- technology turns optical fibers into dense-sampling seismic
ing by providing a fine-grained, scalable, and low-maintenance
monitoring solution. However, the real-world application of DAS recording arrays, offering several benefits. First, DAS records
is hindered by challenges such as noise contamination and inter- absolute signals of human-induced deformation that cannot
ference among closely traveling cars. In response, we introduce be easily tied to any individual. Second, DAS monitoring
a self-supervised U-Net model that can suppress background can be cost-efficient for city-scale monitoring by leveraging
noise and compress car-induced DAS signals into high-resolution ubiquitous pre-existing telecommunication infrastructures as
pulses through spatial deconvolution. Our work extends recent
research by introducing three key advancements. Firstly, we sensors. Finally, the system relies on a single optoelectronic
perform a comprehensive resolution analysis of DAS-recorded device known as an interrogator to be deployed in a secure
traffic signals, laying a theoretical foundation for our approach. and easily accessible location. The DAS approach is in stark
Secondly, we incorporate space-domain vehicle wavelets into contrast to the conventional methods having numerous indi-
our U-Net model, enabling consistent high-resolution outputs vidually powered instruments scattered across a city, exposed
regardless of vehicle speed variations. Finally, we employ L-2
norm regularization in the loss function, enhancing our model’s to meteorological conditions and detrimental interactions with
sensitivity to weaker signals from vehicles in remote traffic lanes. humans, plants, and animals.
We evaluate the effectiveness and robustness of our method
through field recordings under different traffic conditions and
A. Background on DAS
various driving speeds. Our results show that our method
can enhance the spatial-temporal resolution and better resolve DAS-based monitoring is performed by connecting an in-
closely traveling cars. The spatial deconvolution U-Net model terrogator to one end of a standard telecommunications-grade
also enables the characterization of large-size vehicles to identify optical fiber. The interrogator sends short laser pulses into the
axle numbers and estimate the vehicle length. Monitoring large-
size vehicles also benefits imaging deep earth by leveraging the optical fiber and measures the subtle phase shifts of Rayleigh
surface waves induced by the dynamic vehicle-road interaction. scattered light returning to the detector at a predicted two-
way travel time [9], [10]. In this way, the strain field induced
Index Terms—Traffic monitoring, intelligent transportation,
Distributed Acoustic Sensing, deconvolution, U-Net. by natural processes (e.g. earthquakes) and urban activities
(e.g. moving vehicles, construction, pumps) acting on the
fiber coupled to the Earth can be sampled at a meter-scale
I. I NTRODUCTION spatial resolution over tens of linear fiber kilometers. Notably,
DAS technology has proven effective on the pre-existing
T RAFFIC monitoring systems, which automatically and
continuously detect, track, and characterize vehicles in
moving traffic, provide valuable information for urban man-
“dark fiber” telecommunication infrastructure for earthquake
monitoring [11], infrastructure monitoring [12], [13], and near-
surface imaging [14], [15], significantly reducing installation
agement, maintenance, and planning. Conventional monitoring
cost. Furthermore, by incorporating state-of-the-art interroga-
systems include vision-based [1]–[3] and pavement sensing
tors, such as OptaSense QuantX [16], DAS can record full
technologies (e.g., inductive loops [4]–[6] and piezoelectric
waveform signals over distances up to 50 km, with a gran-
sensors [4], [7], [8]). These approaches are well-developed
ular 1 m channel spacing, which makes DAS promising for
but have several drawbacks. For example, camera systems
continuous city-wide sensing [17].
bring individual-privacy concerns and are sensitive to weather
Despite the aforementioned advantages, analyzing data from
conditions; point pavement sensing systems provide spatially
a DAS array located in an urban environment has been
sparse sampling and are challenging to maintain. An additional
challenging because it records a complex mixture of inher-
drawback of these point-sensing systems is their requirement
ently unlabeled signals [18]. As such, researchers have been
for on-site installation. Recent mobile sensing methods over-
developing algorithms that try to detect vehicles accurately
come the on-site installation and maintenance challenge, but
and automatically from DAS recordings.
such systems require cellular connectivity and users to opt-in
location tracking.
B. Existing vehicle tracking and detection algorithms
Siyuan Yuan, Jingxiao Liu, Hae Young Noh, Robert Clapp, and Biondo [19] applied a common seismological method, the short-
Biondi are with Stanford University, CA, U.S.A.
Martijn van den Ende, and Cédric Richard are with the Université Côte time-average through long-time-average trigger (STA/LTA). To
d’Azur,, OCA, UMR Lagrange, France. exploit the array geometry of DAS, beamforming algorithms
JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2022 2
have been applied to detect cars and measure their speed Our first contribution is a comprehensive analysis of the
[20], [21]. These simple methods performed well on roads resolution of DAS-recorded traffic signals, based on both
with relatively light traffic and without complicated traffic physics and field studies. This key element forms the theoreti-
patterns. [22] took this a step further by utilizing the Hough cal bedrock of our method, with a detailed discussion provided
transform, a technique derived from the field of image pro- in Section II.
cessing, to estimate the flow and average speed of vehicles. Secondly, we introduce a novel departure from the method-
[23] introduced data mining and signal processing methods, ology in [26]. Contrary to the use of a Ricker vehicle wavelet
such as clustering algorithms and Kalman filtering techniques, that remains stationary in the time domain, we integrate a
to identify and track vehicles. A novel contribution by [24] physics-based vehicle wavelet in the spatial domain into our
was the application of a real-time object detection algorithm space-domain DAE model. A significant benefit of employing
based on deep learning techniques for estimating traffic flow a spatial wavelet is that it enables our model to produce
and vehicle speed from DAS data, which was assessed along uniformly high-resolution outputs, irrespective of changes in
a 500-meter fiber length in the suburbs of Beijing. More the speed of the vehicle. A detailed discussion is provided in
recently, [25] develop a spatial-domain Bayesian filtering and the Methods Section.
smoothing algorithm to detect, track, and characterize each The third unique aspect of our study involves the opti-
vehicle to obtain fine-grained traffic monitoring with DAS. mization of the regularization term in the loss function. [26]
Despite their limited success, these methods gradually become used the L-1 norm to enhance the sharpness of the outputs.
inaccurate if many vehicles transit simultaneously close to the Similarly, we employed the L-1 norm to amplify the output
same segment of the fiber cable, as signals from different cars sharpness. However, we noticed that the L-1 norm might miss
start overlapping. out on the weak energy released by vehicles traveling on
far-off traffic lanes. Consequently, we investigated the use of
C. Recent advancement that improves the resolution of the L-2 norm regularization, which enabled us to establish
vehicle-induced signals optimal settings to identify weaker signals from vehicles on
A parallel research direction from [26] aims to improve the more distant traffic lanes.
resolution of vehicle signals recorded by DAS by reducing The rest of the paper is organized as follows. Section II
interference among closely traveling cars. The research is valu- demonstrates the resolution reduction of traffic-induced DAS
able as a preprocessing step for algorithms to further improve signals due to a combined effect of physics and the limitation
their detection and tracking ability. Specifically, [26] proposed of the sensors. Through the numerical characterization of vehi-
a self-supervised time-domain deconvolution Auto-Encoder cle impulse responses and observations from field experiments,
(time-domain DAE) with the vehicles’ impulse responses we design a spatial DAE model aiming to improve the signal
from the quasi-static recordings. Compared to a conventional resolution for speed-varying vehicles. Section III describes our
channel-wise deconvolution algorithm, the time-domain DAE spatial DAE model in detail. Section IV describes the training
model has the benefit of incorporating the spatial-temporal procedure and baseline approaches. Section V benchmarks the
characteristics of car signals, leading to much sharper and proposed DAE model with baselines for car motion and speed
more localized outputs. The authors applied a beamforming tracking. Section VI concludes our work and describes future
algorithm to the localized outputs rather than the original direction.
inputs. They showed significant improvements in terms of II. V EHICLE -I NDUCED DAS R ESPONSE
the resolution in car-speed estimation and detection accuracy. This section investigates the vehicle-induced DAS response
Furthermore, as shown in [26], the time-domain DAE model, to inform the design of our proposed space-domain DAE
once trained, can deconvolve 24-hour recordings in less than model. We first review two categories of vehicle-induced DAS
30 seconds, achieving > 400 times speedup compared to responses, quasi-static and surface-wave signals, as a basis for
a conventional iterative approach, which makes the method our study. Subsequently, we carry out a theoretical analysis
promising for real-time processing. and numerical simulations which reveal a resolution decline
However, the time-domain DAE model assumes a stationary in traffic signals due to physical constraints and sensor limita-
Ricker wavelet in the time domain as the vehicle’s impulse tions. This discovery drives the need for resolution enhance-
response. This assumption can undermine vehicle-tracking ment through our novel deconvolution algorithm. Finally, we
accuracy. As the following sections of this paper will show, recognize the speed-invariance of the spatial wavelet, a pivotal
vehicles’ temporal wavelets are non-stationary to speed varia- observation that motivates our development of the space-
tion. Due to the wavelet mismatch, a time-domain DAE model domain DAE model. By incorporating the spatial wavelet into
that works well with fast-speed traffic produces low-resolution our model, we are able to achieve better accuracy with speed
results for low-speed vehicles. variation and better resolution for vehicle tracking.
εx (x, t) = Ex (x − ct − x0 ). (3)
Fig. 5. (Top) DAS recordings of the test car driving with constant speeds of 10, 20, 30 and 40 mph. The time axes are scaled differently. (Bottom) The
corresponding F-K spectra of the DAS recordings above. We can see that the frequency range becomes broader with increasing speed, whereas the wavenumber
components are invariant to car speeds.
This section begins with an outline of the network architec- The primary distinction between our DAE model and the
ture, followed by a detailed explanation of our novel extension conventional time-domain DAE model in [26] lies in the fact
to the original time-domain model. As will be elaborated in that we use a simulated wavelet in the spatial domain as
Section V, our innovative extension enables a more resilient opposed to a Ricker wavelet in the time domain. A principal
model, adept at generating high-quality outcomes that are advantage of this approach is that the impulse response in the
unaffected by speed variations. space domain is not affected by speed and can be associated
with the number of axles and the wheelbase. As a result, our
A. Network Architecture innovative application of a spatial-domain wavelet allows us
Our space-domain DAE model shown in Figure 6 is a 2-D to yield reliable results for vehicles with varying speeds, and
fully convolutional U-Net adapted from [26]. The inputs are retrieve the number of axles, and estimate the wheelbase for
quasi-static traffic recordings, a set of Nx = 256 (256 meters) larger vehicles.
consecutive waveforms of Nt = 1024 time samples (20.48 s) Additionally, our simulated wavelet is estimated based on
in duration, organized in an Nx × Nt matrix. The outputs are the physics defined in Equations (1) through (3). This ground-
sharp deconvolution results with the same shape as the inputs. ing in physics facilitates the integration of the gauge length
The U-Net model comprises 3 convolutional layers, followed and lateral fiber-road offset smoothing effects, which results
by 3 encoder blocks containing a downsampling (max pooling) in a more accurate wavelet and subsequently enhances the
layer and 3 convolutional layers. The kernel sizes for the con- performance of our model.
volution layers are 3 × 5. The number of convolutional filters When dealing with a batch of quasi-static inputs,
is initialized at 8 and gets doubled after each downsampling y1 , y2 , . . . , yNb (Nb being the batch size, Nb = 128), the
operation. The maxpooling operation downsamples the data by loss function is formulated as a combination of the L-2 norm
a factor of 2 along the DAS sensor axis and by a factor of 4 of the difference between the reconstructed input and the
along the time axis (i.e, the maxpooling kernel and strides are original input. Because of the use of the spatial wavelet,
of size 2 × 4). The decoder reverses the encoding operations our reconstructed input is obtained with spatial convolution
with 3 blocks of bilinear upsampling. The U-Net contains skip- between the space-domain impulse response and network
connections, which directly connect the output of one encoder output. This deviates from the temporal convolution in [26].
block with the corresponding decoder block. Lastly, the output In contrast to the exclusive use of the L-1 norm regularization
layer is a single convolutional layer with 1 output channel term in previous work, we explore both the L-1 and L-2
and ReLU activation, which enforces positivity in the model norm of the outputs. This extension allows us to determine
output. Our model is a semi-supervised algorithm, in the sense optimal settings to more accurately extract the weaker signals
that no ground truth deconvolution is required as labels to of vehicles traveling in distant lanes. Our loss function is
train the model. Weak supervision comes from the spatial car defined as follows:
impulse response kernel shown as the red curve in Figure 6. Nb
1 X
L= (||[k ∗ xi ]d − yi ||22 + ρ||xi ||1,2 ), (4)
Nb i=1
B. Distinguishing Features of Our space-domain DAE Model
where xi and yi denote the i-th deconvolution output and
JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2022 6
Fig. 6. Conceptual overview of the spatial DAE model. The input is the quasi-static response of DAS to cars, which can be viewed as a matrix, 256 channels
(256 meters) x 1024 time steps (20.48 seconds). The output is the deconvolution results. The loss is computed with the input and the reconstructed input is
obtained through a spatial convolution of the output with a known car impulse response in the spatial domain.
quasi-static input of the U-Net model, respectively. ρ is a worth of traffic recordings of the Sand Hill DAS fiber. We
weighting term that promotes sparseness in the deconvolved split the 2-hour recordings into a training and evaluation set
results. [∗]d refers to convolution along the sensor axis. k with a ratio of 80% to 20%.
stands for the spatial wavelet. As we will see in the follow-
ing sections, unlike conventional channel-independent linear B. Evaluation baselines
filters, the 2-D deconvolution operations incorporate spatial- As a baseline, we trained a time-domain DAE model with
temporal features in the DAS recordings. The non-linear nature the same dataset. The temporal wavelet used for training is
of the U-Net introduces high frequencies that are not present simulated with a car speed of 30 mph (shown in Fig. 3)
in the inputs, producing sharp and localized outputs. matching the speed limit of the Sand Hill road.
C. Spatial kernel estimation We also benchmark our spatial DAE model using a con-
In practice, the spatial kernel can be estimated either through ventional spatial deconvolution algorithm with an objective
numerical simulation described in the previous section or function:
by performing statistical averaging of responses of multiple 1
passing cars assuming that the spatial impulse response is x̂q = argmin{ ||[k ∗ xq ]d − yq ||22 + ρ||xq ||1 } (5)
xq 2
constant in time at each fiber location. The statistical averaging
approach requires detecting several passing cars in a subsec- Note that [k ∗ xq ]d stands for convolution in space between a
tion of the fiber. The detection can be achieved through manual known spatial impulse response kernel, k, and the underlying
inspection. Herein, we apply a find-local-maximum algorithm impulse model, x̂q stands for the deconvolution output. yq
from the SciPy library [31] to the recordings at quiet midnight represents the input. k and ρ have the same meaning as in
to detect an average waveform from isolated cars. equation (4). One commonly used algorithm to solve this
optimization problem is the Iterative Shrinkage Thresholding
IV. T RAINING AND EVALUATION BASELINES Algorithm (ISTA; [32], [33]). For this study, we adopt an
accelerated version of ISTA (Fast-ISTA or FISTA) due to the
This section aims to outline the steps involved in training reason described in [34], which exhibits faster convergence
our space-domain DAE models and introducing the conven- guarantees. With FISTA performing spatial deconvolution,
tional methods used for evaluation. signals at each time index are processed independently.
A. Car tracking
Fig. 9. (a) Quasi-static signals of passing vehicles in heavy traffic. (b) spatial deconvolution via FISTA. (c) temporal deconvolution via the time-domain DAE
model. Boxes indicate signals in lower resolution due to slower car speeds. (d) and (e) show the results from the proposed space-domain DAE model with
L-1 norm regularization using near and far lane wavelets, respectively. Artifacts that could be misinterpreted as transiting cars are circled out. (f) and (g) show
the results of the space-domain DAE model with L2 regularization using the near and far wavelets, respectively.
JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2022 10
Fig. 10. (a) Signals of an 18-meter bus and two regular-sized cars. Deconvolution results of (b) space-domain DAE model with L-1 regularization, and (c)
space-domain DAE model with L-2 regularization, respectively.
R EFERENCES
[17] B. Biondi, R. G. Clapp, S. Yuan, and F. Huot, Scaling up to pp. 1413–1457, 2004. [Online]. Available: https://onlinelibrary.wiley.
city-wide dark-fiber seismic arrays: Lessons from five years of the com/doi/abs/10.1002/cpa.20042
Stanford DAS array project, 2021, pp. 3225–3229. [Online]. Available: [34] A. Beck and M. Teboulle, “A fast iterative shrinkage-thresholding algo-
https://library.seg.org/doi/abs/10.1190/segam2021-3594539.1 rithm with application to wavelet-based image deblurring,” in 2009 IEEE
[18] F. Huot, E. R. Martin, and B. Biondi, Automated ambient-noise International Conference on Acoustics, Speech and Signal Processing,
processing applied to fiber-optic seismic acquisition (DAS), 2018, pp. 2009, pp. 693–696.
4688–4692. [Online]. Available: https://library.seg.org/doi/abs/10.1190/ [35] C. B. Park, R. D. Miller, and H. Miura, “Optimum field parameters of
segam2018-2997880.1 an masw survey,” Japanese Society of Exploration Geophysics Extended
[19] N. J. Lindsey, S. Yuan, A. Lellouch, L. Gualtieri, T. Lecocq, and Abstracts, vol. 36, 2002.
B. Biondi, “City-scale dark fiber das measurements of infrastructure use
during the covid-19 pandemic,” Geophysical Research Letters, vol. 47,
no. 16, p. e2020GL089931, 2020, e2020GL089931 2020GL089931.
[Online]. Available: https://agupubs.onlinelibrary.wiley.com/doi/abs/10.
1029/2020GL089931
[20] X. Wang, Z. Zhan, E. F. Williams, M. G. Herráez, H. F. Martins, and
M. Karrenbach, “Ground vibrations recorded by fiber-optic cables reveal
traffic response to covid-19 lockdown measures in pasadena, california,”
Communications Earth & Environment, vol. 2, 2021.
[21] M. van den Ende, A. Ferrari, A. Sladen, and C. Richard, “Next-
generation traffic monitoring with distributed acoustic sensing arrays
and optimum array processing,” in 2021 55th Asilomar Conference on
Signals, Systems, and Computers, 2021, pp. 1104–1108.
[22] C. Wiesmeyr, C. Coronel, M. Litzenberger, H. J. Döller, H.-B.
Schweiger, and G. Calbris, “Distributed acoustic sensing for vehicle
speed and traffic flow estimation,” in 2021 IEEE International Intelligent
Transportation Systems Conference (ITSC). IEEE Press, 2021, p.
2596–2601. [Online]. Available: https://doi.org/10.1109/ITSC48978.
2021.9564517
[23] B. Chan, E. R. Korfanty, S. Nataj, J. Park, B. Peng, and
J. Zhang, “Traffic Monitoring with Distributed Acoustic Sensing,”
2020, [Online; accessed 13-June-2023]. [Online]. Available: https:
//m2pi.ca/project/2020/fotech-solutions/Fotech-final.pdf
[24] Z. Ye, W. Wang, X. Wang, F. Yang, F. Peng, K. Yan, H. Kou, and
A. Yuan, “Traffic flow and vehicle speed monitoring with the object
detection method from the roadside distributed acoustic sensing array,”
Frontiers in Earth Science, vol. 10, 01 2023.
[25] J. Liu, S. Yuan, Y. Dong, B. Biondi, and H. Y. Noh, “Telecomtm: A
fine-grained and ubiquitous traffic monitoring system using pre-existing
telecommunication fiber-optic cables as sensors,” Proc. ACM Interact.
Mob. Wearable Ubiquitous Technol., vol. 7, no. 2, jun 2023. [Online].
Available: https://doi.org/10.1145/3596262
[26] M. van den Ende, A. Ferrari, A. Sladen, and C. Richard, “Deep
deconvolution for traffic analysis with distributed acoustic sensing data,”
IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 3,
pp. 2947–2962, 2023.
[27] P. Jousset, T. Reinsch, T. Ryberg, H. Blanck, A. Clarke, R. Aghayev,
G. P. Hersir, J. Henninges, M. Weber, and C. M. Krawczyk, “Dynamic
strain determination using fibre-optic cables allows imaging of seismo-
logical and structural features,” Nature communications, vol. 9, no. 1,
pp. 1–11, 2018.
[28] S. Yuan, A. Lellouch, R. G. Clapp, and B. Biondi, “Near-surface
characterization using a roadside distributed acoustic sensing array,”
The Leading Edge, vol. 39, no. 9, pp. 646–653, 09 2020. [Online].
Available: https://doi.org/10.1190/tle39090646.1
[29] Y. Fung, “Foundations of solid mechanics prentice-hall,” Inc, New
Jersey, 1965.
[30] L. Li, S. Nimbalkar, and R. Zhong, “Finite element model of
ballasted railway with infinite boundaries considering effects of moving
train loads and rayleigh waves,” Soil Dynamics and Earthquake
Engineering, vol. 114, pp. 147–153, 2018. [Online]. Available:
https://www.sciencedirect.com/science/article/pii/S0267726118303968
[31] P. Virtanen, R. Gommers, T. E. Oliphant, M. Haberland, T. Reddy,
D. Cournapeau, E. Burovski, P. Peterson, W. Weckesser, J. Bright, S. J.
van der Walt, M. Brett, J. Wilson, K. J. Millman, N. Mayorov, A. R. J.
Nelson, E. Jones, R. Kern, E. Larson, C. J. Carey, İ. Polat, Y. Feng, E. W.
Moore, J. VanderPlas, D. Laxalde, J. Perktold, R. Cimrman, I. Henrik-
sen, E. A. Quintero, C. R. Harris, A. M. Archibald, A. H. Ribeiro,
F. Pedregosa, P. van Mulbregt, and SciPy 1.0 Contributors, “SciPy 1.0:
Fundamental Algorithms for Scientific Computing in Python,” Nature
Methods, vol. 17, pp. 261–272, 2020.
[32] A. Chambolle, R. De Vore, N.-Y. Lee, and B. Lucier, “Nonlinear wavelet
image processing: variational problems, compression, and noise removal
through wavelet shrinkage,” IEEE Transactions on Image Processing,
vol. 7, no. 3, pp. 319–335, 1998.
[33] I. Daubechies, M. Defrise, and C. De Mol, “An iterative thresholding
algorithm for linear inverse problems with a sparsity constraint,”
Communications on Pure and Applied Mathematics, vol. 57, no. 11,
JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2022 13
Siyuan Yuan is a Ph.D. candidate in Geophysics Hae Young Noh is an Associate Professor in the
at Stanford University. His research involves digital Department of Civil and Environmental Engineering
city applications of Distributed Acoustic Sensing at Stanford University. Her research focuses on
(DAS) repurposing pre-existing telecommunication indirect sensing and physics-guided data analytics to
fibers as large-scale sensors for urban traffic mon- enable low-cost non-intrusive monitoring of cyber-
itoring, near-surface imaging with vehicle-induced physical-human systems. She is particularly inter-
surface waves, car-based fiber mapping, and struc- ested in developing structures to be self-, user-, and
tural health monitoring. Additionally, he is interested surrounding-aware to improve users’ quality of life
in Machine Learning based speech enhancement and provide safe and sustainable built environment.
technologies. Before his Ph.D. study, he received a The results of her work have been deployed in a
M.S. degree in Civil Engineering from Stanford, and number of real-world applications from trains, to
a B.S. degree in Civil Engineering from Tongji University, China. the Amish community, to eldercare centers, to pig farms. Before joining
Stanford, she was a faculty member at Carnegie Mellon University. She
received her Ph.D. and M.S. degrees in Civil and Environmental Engineering
and the second M.S. degree in Electrical Engineering at Stanford University.
She earned her B.S. degree in Mechanical and Aerospace Engineering at
Cornell University. She received several awards, including the Google Faculty
Research Awards (2013, 2016), the Dean’s Early Career Fellowship (2018),
the NSF CAREER Award (2017), and various Best Paper Awards from ASCE,
ASME, ACM, IEEE, and SEM conferences.