Marx Simons3
Marx Simons3
Dániel Marx
1
Exponential Time Hypothesis (ETH)
Hypothesis introduced by Impagliazzo, Paturi, and Zane:
2
Exponential Time Hypothesis (ETH)
Hypothesis introduced by Impagliazzo, Paturi, and Zane:
2
ETH 2f (n) f (k) · nO(1)
3
Lower bounds based on ETH
Exponential Time Hypothesis (ETH)
There is no 2o(m) -time algorithm for m-clause 3SAT.
The textbook reduction from 3SAT to 3-Coloring:
Corollary
Assuming ETH, there is no 2o(n) algorithm for 3-Coloring on an
n-vertex graph G .
4
Lower bounds based on ETH
Exponential Time Hypothesis (ETH)
There is no 2o(m) -time algorithm for m-clause 3SAT.
The textbook reduction from 3SAT to 3-Coloring:
Corollary
Assuming ETH, there is no 2o(n) algorithm for 3-Coloring on an
n-vertex graph G .
4
Transfering bounds
There are polynomial-time reductions from, say, 3-Coloring to
many other problems such that the reduction increases the number
of vertices by at most a constant factor.
Consequence: Assuming ETH, there is no 2o(n) time algorithm on
n-vertex graphs for
Independent Set
Clique
Dominating Set
Vertex Cover
Hamiltonian Path
Feedback Vertex Set
...
5
Transfering bounds
There are polynomial-time reductions from, say, 3-Coloring to
many other problems such that the reduction increases the number
of vertices by at most a constant factor.
Consequence: Assuming ETH, there is no 2o(k) · nO(1) time algo-
rithm for
k-Independent Set
k-Clique
k-Dominating Set
k-Vertex Cover
k-Path
k-Feedback Vertex Set
...
5
Transfering bounds
There are polynomial-time reductions from, say, 3-Coloring to
many other problems such that the reduction increases the number
of vertices by at most a constant factor.
Consequence: Assuming ETH, there is no 2o(k) · nO(1) time algo-
rithm for
k-Independent Set
k-Clique
k-Dominating Set
k-Vertex Cover
k-Path
k-Feedback Vertex Set
...
5
Transfering bounds
There are polynomial-time reductions from, say, 3-Coloring to
many other problems such that the reduction increases the number
of vertices by at most a constant factor.
Consequence: Assuming ETH, there is no 2o(k) · nO(1) time algo-
rithm for
k-Independent Set
k-Clique
k-Dominating Set 2O(k)
k-Vertex Cover
k-Path
k-Feedback Vertex Set
...
5
Lower bounds based on ETH
What about 3-Coloring on planar graphs?
The textbook reduction from 3-Coloring to Planar
3-Coloring uses a “crossover gadget” with 4 external connectors:
Corollary
√
Assuming ETH, there is no 2o( n) algorithm for 3-Coloring on
an n-vertex planar graph G .
(Essentially observed by [Cai and Juedes 2001])
7
Lower bounds for planar problems
√
Consequence: Assuming ETH, there is no 2o( n) time algorithm
on n-vertex planar graphs for
Independent Set
Dominating Set
Vertex Cover
Hamiltonian Path
Feedback Vertex Set
...
8
Lower bounds for planar problems
√
Consequence: Assuming ETH, there is no 2o( k) · nO(1) time algo-
rithm on planar graphs for
k-Independent Set
k-Dominating Set
k-Vertex Cover
k-Path
k-Feedback Vertex Set
...
8
Lower bounds for planar problems
√
Consequence: Assuming ETH, there is no 2o( k) · nO(1) time algo-
rithm on planar graphs for
k-Independent Set
k-Dominating Set
k-Vertex Cover
k-Path
k-Feedback Vertex Set
...
Note: Reduction to planar graphs does not work for Clique
(why?).
8
Treewidth
Recall from Tuesday:
FPT algorithms parameterized by treewidth.
9
Treewidth
10
Treewidth
10
Treewidth
11
Treewidth
11
Edge Clique Cover
Edge Clique Cover: Given a graph G and an integer k, cover
the edges of G with at most k cliques.
(the cliques need not be edge disjoint)
12
Edge Clique Cover
Edge Clique Cover: Given a graph G and an integer k, cover
the edges of G with at most k cliques.
(the cliques need not be edge disjoint)
6 cliques
12
Edge Clique Cover
Edge Clique Cover: Given a graph G and an integer k, cover
the edges of G with at most k cliques.
(the cliques need not be edge disjoint)
5 cliques
12
Edge Clique Cover
Edge Clique Cover: Given a graph G and an integer k, cover
the edges of G with at most k cliques.
(the cliques need not be edge disjoint)
12
Edge Clique Cover
Edge Clique Cover: Given a graph G and an integer k, cover
the edges of G with at most k cliques.
(the cliques need not be edge disjoint)
12
ETH nf (k)
13
Exponential Time Hypothesis
Engineers’ Hypothesis
k-Clique cannot be solved in time f (k) · nO(1) .
Theorists’ Hypothesis
k-Step Halting Problem (is there a path of the given NTM
that stops in k steps?) cannot be solved in time f (k) · nO(1) .
14
Exponential Time Hypothesis
Engineers’ Hypothesis
k-Clique cannot be solved in time f (k) · nO(1) .
Theorists’ Hypothesis
k-Step Halting Problem (is there a path of the given NTM
that stops in k steps?) cannot be solved in time f (k) · nO(1) .
Theorists’ Hypothesis
k-Step Halting Problem (is there a path of the given NTM
that stops in k steps?) cannot be solved in time f (k) · nO(1) .
15
Lower bound on the exponent
Theorem [Chen et al. 2004]
Assuming ETH, there is no f (k) · no(k) algorithm for k-Clique for
any computable function f .
Suppose that k-Clique can be solved in time f (k) · nk/s(k) , where
s(k) is a monotone increasing unbounded function. We use this
algorithm to solve 3-Coloring on an n-vertex graph G in time
2o(n) .
Let k be the largest integer such that f (k) ≤ n and k k/s(k) ≤ n.
Function k := k(n) is monotone increasing and unbounded.
Split the vertices of G into k groups. Let us build a graph H where
each vertex corresponds to a proper 3-coloring of one of the groups.
Connect two vertices if they are not conflicting.
15
Lower bound on the exponent
Theorem [Chen et al. 2004]
Assuming ETH, there is no f (k) · no(k) algorithm for k-Clique for
any computable function f .
Suppose that k-Clique can be solved in time f (k) · nk/s(k) , where
s(k) is a monotone increasing unbounded function. We use this
algorithm to solve 3-Coloring on an n-vertex graph G in time
2o(n) .
Let k be the largest integer such that f (k) ≤ n and k k/s(k) ≤ n.
Function k := k(n) is monotone increasing and unbounded.
Split the vertices of G into k groups. Let us build a graph H where
each vertex corresponds to a proper 3-coloring of one of the groups.
Connect two vertices if they are not conflicting.
Every k-clique of H corresponds to a proper 3-coloring of G .
⇒ A 3-coloring of G can be found in time
f (k) · |V (H)|k/s(k) ≤ n · (k3n/k )k/s(k) = n · k k/s(k) · 3n/s(k) = 2o(n) . 15
Tight bounds
Theorem [Chen et al. 2004]
Assuming ETH, there is no f (k) · no(k) algorithm for k-Clique for
any computable function f .
Transfering to other problems:
k-Clique Problem A
⇒
(x, k) (x 0 , O(k))
16
Tight bounds
Theorem [Chen et al. 2004]
Assuming ETH, there is no f (k) · no(k) algorithm for k-Clique for
any computable function f .
Transfering to other problems:
k-Clique Problem A
⇒
(x, k) (x 0 , g (k))
−1
f (k) · no(k) o(g (k))
⇐ f (k) · n
algorithm algorithm
16
Tight bounds
Theorem [Chen et al. 2004]
Assuming ETH, there is no f (k) · no(k) algorithm for k-Clique for
any computable function f .
Transfering to other problems:
k-Clique Problem A
⇒
(x, k) (x 0 , k 2 )
√
f (k) · no(k) f (k) · no( k)
⇐
algorithm algorithm
16
Tight bounds
Theorem [Chen et al. 2004]
Assuming ETH, there is no f (k) · no(k) algorithm for k-Clique for
any computable function f .
Transfering to other problems:
k-Clique Problem A
⇒
(x, k) (x 0 , k 2 )
√
f (k) · no(k) f (k) · no( k)
⇐
algorithm algorithm
Bottom line:
To rule out f (k) · no(k) algorithms, we need a parameterized
reduction that blows up √
the parameter at most linearly.
To rule out f (k) · n o( k) algorithms, we need a parameterized
reduction that blows up the parameter at most quadratically.
16
Tight bounds
Assuming ETH, there is no f (k)no(k) time algorithms for
Set Cover
Hitting Set
Connected Dominating Set
Independent Dominating Set
Partial Vertex Cover
Dominating Set in bipartite graphs
...
17
The odd case of Odd Set
Odd Set: Given a set system F over a universe U and an integer
k, find a set S of at most k elements such that |S ∩ F | is odd for
every F ∈ F.
We have seen:
Theorem
Odd Set is W[1]-hard parameterized by k.
V1 V2 V3 V4
New parameter: k 0 := k + k
= O(k 2 ).
2
18
The odd case of Odd Set
Odd Set: Given a set system F over a universe U and an integer
k, find a set S of at most k elements such that |S ∩ F | is odd for
every F ∈ F.
We have seen:
Theorem
Odd Set is W[1]-hard parameterized by k.
We immediately get:
Corollary
√
Assuming ETH, there is no f (k)no( k) time algorithm for Odd
Set.
But this does not seem to be tight. . .
Problem: k-Clique is a very densely constrained problem, which
makes the reduction very expensive.
18
Subgraph Isomorphism
Subgraph Isomorphism: Given two graphs H and G , decide if
H is isomorphic to a subgraph of G .
19
Subgraph Isomorphism
Subgraph Isomorphism: Given two graphs H and G , decide if
H is isomorphic to a subgraph of G .
19
Subgraph Isomorphism
Subgraph Isomorphism: Given two graphs H and G , decide if
H is isomorphic to a subgraph of G .
k
New parameter: k 0 := k + = O(k 2 ).
2
20
Odd Set
Reduction from Subgraph Isomorphism to Odd Set:
V1 V2 V3 V4
20
Odd Set
Reduction from Subgraph Isomorphism to Odd Set:
V1 V2 V3 V4
Theorem
Assuming ETH, there is no f (k)no(k/ log k) time algorithm for Odd
Set.
20
Tight bounds
Assuming ETH, there is no f (k)no(k) time algorithms for
Set Cover
Hitting Set
Connected Dominating Set
Independent Dominating Set
Partial Vertex Cover
Dominating Set in bipartite graphs
...
21
Tight bounds
Assuming ETH, there is no f (k)no(k) time algorithms for
Set Cover
Hitting Set
Connected Dominating Set
Independent Dominating Set
Partial Vertex Cover
Dominating Set in bipartite graphs
...
21
Grid Tiling
Grid Tiling
A k × k matrix and a set of pairs Si,j ⊆ [D] × [D] for
Input:
each cell.
A pair si,j ∈ Si,j for each cell such that
Vertical neighbors agree in the 1st coordinate.
Find:
Horizontal neighbors agree in the 2nd coordinate.
(1,1) (5,1) (1,1)
(3,1) (1,4) (2,4)
(2,4) (5,3) (3,3)
(2,2) (3,1) (2,2)
(1,4) (1,2) (2,3)
(1,3)
(1,1) (2,3)
(2,3)
(1,3) (5,3)
(3,3)
k = 3, D = 5
22
Grid Tiling
Grid Tiling
A k × k matrix and a set of pairs Si,j ⊆ [D] × [D] for
Input:
each cell.
A pair si,j ∈ Si,j for each cell such that
Vertical neighbors agree in the 1st coordinate.
Find:
Horizontal neighbors agree in the 2nd coordinate.
(1,1) (5,1) (1,1)
(3,1) (1,4) (2,4)
(2,4) (5,3) (3,3)
(2,2) (3,1) (2,2)
(1,4) (1,2) (2,3)
(1,3)
(1,1) (2,3)
(2,3)
(1,3) (5,3)
(3,3)
k = 3, D = 5
22
Grid Tiling
Grid Tiling
A k × k matrix and a set of pairs Si,j ⊆ [D] × [D] for
Input:
each cell.
A pair si,j ∈ Si,j for each cell such that
Vertical neighbors agree in the 1st coordinate.
Find:
Horizontal neighbors agree in the 2nd coordinate.
Simple proof:
Fact
There is a parameterized reduction from k-Clique to k × k Grid
Tiling.
22
Grid Tiling is W[1]-hard
Reduction from k-Clique
Definition of the sets:
For i = j: (x, y ) ∈ Si,j ⇐⇒ x = y
For i 6= j: (x, y ) ∈ Si,j ⇐⇒ x and y are adjacent.
(vi , vi )
(vi , .)
(vi , .)
(vi ., )
(vi , .)
(vi , .)
(vi , .)
(vi , .) (vj , vj )
(vi , .)
(vi , .) (vj , .)
(vi , .) (vj , .)
(vi , .) (vj , .)
24
A classical problem
s − t Cut
Input: A graph G , an integer p, vertices s and t
A set S of at most p edges such that removing S sep-
Output:
arates s and t.
25
More than two terminals
k-Terminal Cut (aka Multiway Cut)
Input: A graph G , an integer p, and a set T of k terminals
A set S of at most p edges such that removing S sep-
Output:
arates any two vertices of T
26
More than two terminals
k-Terminal Cut (aka Multiway Cut)
Input: A graph G , an integer p, and a set T of k terminals
A set S of at most p edges such that removing S sep-
Output:
arates any two vertices of T
Natural questions:
√
Is there an f (k) · no( k) time algorithm?
Is there an f (k) ·nO(1)time algorithm (i.e., is it
fixed-parameter tractable)?
27
Lower bounds
Theorem [Klein and M. 2012]
√
Planar k-Terminal Cut can be solved in time 2O(k) · nO( k) .
Natural questions:
√
Is there an f (k) · no( k) time algorithm?
Is there an f (k) ·nO(1)time algorithm (i.e., is it
fixed-parameter tractable)?
Lower bounds:
Theorem [M. 2012]
√
Planar k-Terminal Cut is W[1]-hard and has no f (k) · no( k)
27
Reduction from k × k Grid Tiling
to Planar k 2 -Terminal Cut
For every set Si,j , we construct a gadget with 4 terminals such that
for every (x, y ) ∈ Si,j , there is a minimum multiway cut that
represents (x, y ).
every minimum multiway cut represents some (x, y ) ∈ Si,j .
`1 r1
`2 r2
`3 r3
`4 r4
`5 r5
DL d1 d2 d3 d4 d5 DR
The gadget. 28
Reduction from k × k Grid Tiling
to Planar k 2 -Terminal Cut
For every set Si,j , we construct a gadget with 4 terminals such that
for every (x, y ) ∈ Si,j , there is a minimum multiway cut that
represents (x, y ).
every minimum multiway cut represents some (x, y ) ∈ Si,j .
`1 r1
`2 r2
`3 r3
`4 r4
`5 r5
DL d1 d2 d3 d4 d5 DR
`1 r1
`2 r2
`3 r3
`4 r4
`5 r5
DL d1 d2 d3 d4 d5 DR
29
Putting together the gadgets
Oops!
29
Putting together the gadgets
29
Grid Tiling with ≤
Grid Tiling with ≤
A k × k matrix and a set of pairs Si,j ⊆ [D] × [D] for
Input:
each cell.
A pair si,j ∈ Si,j for each cell such that
1st coordinate of si,j ≤ 1st coordinate of si+1,j .
Find:
2nd coordinate of si,j ≤ 2nd coordinate of si,j+1 .
(5,1)
(4,3) (2,3)
(1,2)
(3,2) (2,5)
(3,3)
(2,1)
(4,2) (5,1)
(5,5)
(5,3) (3,2)
(3,5)
(5,1) (3,1)
(2,1)
(2,2) (3,2)
(4,2)
(5,3) (3,3)
k = 3, D = 5
30
Grid Tiling with ≤
Grid Tiling with ≤
A k × k matrix and a set of pairs Si,j ⊆ [D] × [D] for
Input:
each cell.
A pair si,j ∈ Si,j for each cell such that
1st coordinate of si,j ≤ 1st coordinate of si+1,j .
Find:
2nd coordinate of si,j ≤ 2nd coordinate of si,j+1 .
Theorem
There is a parameterized reduction from k × k-Grid Tiling to
O(k) × O(k) Grid Tiling with ≤.
30
k-Independent Set for unit disks
Theorem
Given a set of n unit
√ disks in the plane, we can find k independent
disks in time nO( k) .
31
k-Independent Set for unit disks
Theorem
Given a set of n unit
√ disks in the plane, we can find k independent
disks in time nO( k) .
31
Reduction to unit disks
(5,1)
(4,3) (2,3)
(1,2)
(3,2) (2,5)
(3,3)
(2,1)
(4,2) (5,1)
(5,5)
(5,3) (3,2)
(3,5)
(5,1) (3,1)
(2,1)
(2,2) (3,2)
(4,2)
(5,3) (3,3)
32
Reduction to unit disks
(5,1)
(4,3) (2,3)
(1,2)
(3,2) (2,5)
(3,3)
(2,1)
(4,2) (5,1)
(5,5)
(5,3) (3,2)
(3,5)
(5,1) (3,1)
(2,1)
(2,2) (3,2)
(4,2)
(5,3) (3,3)
32
Reduction to unit disks
(5,1)
(4,3) (2,3)
(1,2)
(3,2) (2,5)
(3,3)
(2,1)
(4,2) (5,1)
(5,5)
(5,3) (3,2)
(3,5)
(5,1) (3,1)
(2,1)
(2,2) (3,2)
(4,2)
(5,3) (3,3)
32
Center-pivot irrigation
33
Higher dimensions
Bidimensionalty for planar graphs:
√ √ √
2O( n) , 2O( k) · nO(1) , nO( k) time algorithms.
There is no tridimensionalty!
34
Higher dimensions
Bidimensionality for 2-dimensional geometric problems:
√ √ √
2O( n) , 2O( k) · nO(1) , nO( k) time algorithms.
What about higher dimensions?
34
Higher dimensions
Bidimensionality for 2-dimensional geometric problems:
√ √ √
2O( n) , 2O( k) · nO(1) , nO( k) time algorithms.
What about higher dimensions?
34
Higher dimensions
Bidimensionality for 2-dimensional geometric problems:
√ √ √
2O( n) , 2O( k) · nO(1) , nO( k) time algorithms.
What about higher dimensions?
34
Summary
We used ETH to rule out
1 2o(n) time algorithms for, say, Independent Set.
√
2 2o( n) time algorithms for, say, Independent Set on planar
graphs.
3 2o(k) · nO(1) time algorithms for, say, Vertex Cover.
√
4 2o( k) · nO(1) time algorithms for, say, Vertex Cover on
planar graphs.
5 f (k)no(k) time algorithms for Clique.
√
6 f (k)no( k) time algorithms for planar problems such as
k-Terminal Cut and Independent Set for unit disks.
2
Other tight lower bounds on f (k) having the form 2o(k log k) , 2o(k ) ,
o(k)
or 22 exist.
35