Constrained Optimization
So far we have discussed optimizing functions without placing
restrictions upon the values that the independent variables can
assume. Such problems are often referred to as free maxima and
minima or free optima.
However, in the real world, often
restrictions or constraints are placed upon
values of the independent variables.
These problems are referred to as
constrained optima or constrained
optimization.
Constrained Optimization
Graphically, the difference between the free optima
and the constrained optima can be shown as:
Free
Constrained maximum
maximum
constraint
Free
Constrained maximum
maximum
constraint
The free optima occurs at the peak of the surface.
If we specify a specific relationship between variables
and and (a constraint) then the search for an
optimum is restricted to a slice of the surface. The
constrained maximum occurs at the peak of the slice.
Constrained Optimization
Since economists deal with the allocation of scarce
resources among alternative uses, the concept of
constraints or restrictions is important.
There are two approaches to solving constrained
optima problems:
(i) substitution method
(ii) Lagrange multipliers
Substitution Method
Consider a firm producing commodity with the
following production function:
Without any constraints, the firm can produce an
unlimited quantity by utilizing an unlimited amount
of and .
Substitution Method
But suppose the firm has a budget constraint:
Let
For simplicity, assume that the maximum amount the
firm can spend on these two inputs is $100.
So we have the following constraint:
Substitution Method
Suppose the economic question facing this firm is
maximizing production subject to this budget
constraint.
The solution via the substitution method is to
substitute:
– First, write the constraint in terms of :
Substitution Method
– Then substitute this value into the production
function, such that:
– With this substitution, the constrained maxima
problem is reduced to a free maxima problem
with one independent variable.
Substitution Method
– Now apply the usual optimization procedure:
(critical value)
Substitution Method
◦ The method of substitution is one way to solve
constrained optima problems. This is manageable
in some cases. In others, the constraint may be very
complicated and substitution becomes complex.
Lagrange Multipliers
The constrained optima problem can be stated as
finding the extreme value of
subject to .
So Lagrange (a mathematician) formed the
augmented function.
denotes augmented function
will behave like the function if the constraint is followed.
Lagrange Multipliers
Given the augmented function, the first order
condition for optimization (where the independent
variables are , and λ) is as follows:
Lagrange Multipliers
Using the previous example:
note:
to be on the budget
line
Lagrange Multipliers
Solving these 3 equations simultaneously:
Lagrange Multipliers
Solving these 3 equations simultaneously (cont’d):
Lagrange Multipliers
Solving these 3 equations simultaneously (cont’d):
Lagrange Multipliers
If , then
This solution yields the same answer as the substitution
method, i.e., and .
Lagrange Multipliers
Economists prefer using the Lagrange technique over
the substitution method, because:
(i) easier to handle for most cases and
(ii) provides additional information.
Namely for (ii), the value of λ has an economic
interpretation. (There is no counterpart to this variable
in the substitution method).
Lagrange Multipliers
Given,
where C is the level of expenditures
(budget = $100 in this example).
here the Lagrange multiplier measures the
sensitivity of to changes in the constraint
(C ).
Lagrange Multipliers
2nd order conditions
Given
1st order conditions for extremum:
Lagrange Multipliers
2nd order conditions involve second order partial
derivatives expressed in the form of a determinant.
In the constraint case, we will utilize the bordered
Hessian – which is the Hessian of the free optima case
surrounded by the partial derivatives with respect to
the Lagrange multiplier λ.
Lagrange Multipliers
2nd order partials:
Lagrange Multipliers
2nd order partials:
Lagrange Multipliers
Note: partials with respect to Lagrange
multiplier (λ) form the border
2 explanatory variables and 1 constraint is the largest
size bordered Hessian we will consider for this class.
Nevertheless, this problem can be extended to any
number of variables and constrains!!!
Lagrange Multipliers
So the 2nd order condition is:
Let’s now return to our previous example:
◦ Recall the critical values of ,
and .
Lagrange Multipliers
What about the 2nd order conditions?
Find
Lagrange Multipliers
Expand by 1st row:
Lagrange Multipliers
represents a rel max.
The criteria to characterize bordered hessians differs from the ordinary hessians.
At this level, we are not going to present the rule, but be aware of this topic.
Lagrange Multipliers EXERCISES
Use the method of Lagrange Multipliers to find the extrema of the following
Functions subject to the given constrains.
A farmer has 400 meters of fence with which to fence in a rectangular field
adjoininig two existing fences which meet at a right angle. What dimensions
maximize the área of the field
Lagrange Multipliers example
1. A tomato can is to have a volumen of 850 cm3. Find the heigh (h) and
radius (r) of the can that will minimize surface área fo the can. What is
the relationship between the resulting r and h?
2. Suppose that production at an Acme widget factory is modeled by a Cobb-
Douglass function
f(x,y) = 500x0.4 y0.8
where x is the number of labor units and y is units of capital expenditure. If a
labor costs €60 per unit and capital costs €35 per unit, what is the least costly
combination of labor and capital that will produce 10,000 widgets
