Partial Differentiation - Theory & Concepts

Partial Differentiation

Real-world engineering problems rarely involve just one variable. The stress in a beam depends on load, length, and cross-section. The volume of a gas depends on pressure and temperature. To analyze these, we need multivariable calculus.

Functions of Several Variables

Multivariable Function

A function $z = f(x, y)$ assigns a unique output $z$ for every pair $(x, y)$ in its domain. The graph of such a function is a surface in 3D space.

Partial Derivatives

When we differentiate a function of multiple variables, we must specify which variable is changing while holding the others constant. This is a partial derivative.

Notation

$\frac{\partial z}{\partial x}$ or $f_x$ : Partial derivative with respect to $x$ (treat $y$ as constant).
$\frac{\partial z}{\partial y}$ or $f_y$ : Partial derivative with respect to $y$ (treat $x$ as constant).
Note the use of the "curly d" symbol ( $\partial$ ).

Interact with the simulation below to explore partial derivatives.

Partial Derivatives

Visualizing Surface: $z = 0.5(x^2 - y^2)$
Red Arrow: Slope along x-axis ( $\partial z / \partial x$ )
Green Arrow: Slope along y-axis ( $\partial z / \partial y$ )

x position0.50

y position0.50

z value:0.00

Slope X (

\partial z/\partial x

):0.50

Slope Y (

\partial z/\partial y

):-0.50

Drag to Rotate | Scroll to Zoom

Higher-Order Partial Derivatives

Just like single-variable functions, we can take second derivatives.

Second-Order Partial Derivatives

$f_{xx} = \frac{\partial^2 z}{\partial x^2}$
$f_{yy} = \frac{\partial^2 z}{\partial y^2}$
$f_{xy} = \frac{\partial^2 z}{\partial x \partial y}$ (Mixed partial: differentiate w.r.t $x$ then $y$ )
$f_{yx} = \frac{\partial^2 z}{\partial y \partial x}$ (Mixed partial: differentiate w.r.t $y$ then $x$ )

Clairaut's Theorem

Clairaut's Theorem: If the mixed partial derivatives are continuous, then the order doesn't matter: $f_{xy} = f_{yx}$ .

Extrema of Functions of Two Variables (Second Partials Test)

To find the relative maxima and minima of a surface

z = f(x, y)

, we first find critical points where

f_x = 0

and

f_y = 0

. Then, we use the Second Partials Test (involving the Hessian determinant) to classify them.

The Second Partials Test

STEP-BY-STEP

Find all critical points $(a, b)$ such that $f_x(a, b) = 0$ and $f_y(a, b) = 0$ .
Compute the second partial derivatives: $f_{xx}$ , $f_{yy}$ , and $f_{xy}$ .
Evaluate the discriminant (Hessian determinant) at $(a, b)$ : $D = f_{xx}(a, b) f_{yy}(a, b) - [f_{xy}(a, b)]^2$

Classify the point based on $D$ :

If $D > 0$ and $f_{xx}(a, b) > 0$ , then $f(a, b)$ is a local minimum.
If $D > 0$ and $f_{xx}(a, b) < 0$ , then $f(a, b)$ is a local maximum.
If $D < 0$ , then $(a, b)$ is a saddle point (neither max nor min, looks like a horse saddle).
If $D = 0$ , the test is inconclusive.

Lagrange Multipliers

Optimization problems in engineering often come with constraints. For instance, maximizing the volume of a box given a fixed amount of surface area material. The method of Lagrange Multipliers solves constrained optimization problems.

Method of Lagrange Multipliers

To maximize or minimize $f(x, y, z)$ subject to the constraint $g(x, y, z) = c$ , we find the points where the gradient of $f$ is parallel to the gradient of $g$ . This introduces a scalar parameter $\lambda$ (lambda).

Method of Lagrange Multipliers

Gradient relationship for constrained optimization.

\nabla f = \lambda \nabla g

Variables

Symbol	Description	Unit
$\nabla f$	Gradient of the objective function	-
$\lambda$	Lagrange multiplier	-
$\nabla g$	Gradient of the constraint function	-

This expands into a system of equations:

f_x = \lambda g_x

f_y = \lambda g_y

f_z = \lambda g_z

, along with the original constraint

g(x,y,z) = c

. Solving this system yields the constrained critical points.

Chain Rule for Several Variables

z = f(x, y)

where

x

and

y

are themselves functions of another variable

t

, then the total derivative of

z

with respect to

t

is:

Chain Rule for Several Variables

Total derivative with respect to a parameter t.

\frac{dz}{dt} = \frac{\partial z}{\partial x}\frac{dx}{dt} + \frac{\partial z}{\partial y}\frac{dy}{dt}

Variables

Symbol	Description	Unit
$\frac{dz}{dt}$	Total derivative of z with respect to t	-
$\frac{\partial z}{\partial x}, \frac{\partial z}{\partial y}$	Partial derivatives of z	-
$\frac{dx}{dt}, \frac{dy}{dt}$	Derivatives of intermediate variables	-

Implicit Partial Differentiation

Often, an equation

F(x, y, z) = 0

defines

z

implicitly as a function of

x

and

y

. Instead of solving for

z

, we can find the partial derivatives using the Implicit Function Theorem.

Implicit Function Theorem Formula

To find the partial derivative of $z$ with respect to $x$ or $y$ :

Implicit Partial Derivative (w.r.t x)

Finding partial derivative implicitly.

\frac{\partial z}{\partial x} = -\frac{F_x(x, y, z)}{F_z(x, y, z)}

Variables

Symbol	Description	Unit
$\frac{\partial z}{\partial x}$	Partial derivative of z with respect to x	-
$F_{x}, F_{z}$	Partial derivatives of implicit function F	-

Implicit Partial Derivative (w.r.t y)

Finding partial derivative implicitly.

\frac{\partial z}{\partial y} = -\frac{F_y(x, y, z)}{F_z(x, y, z)}

Variables

Symbol	Description	Unit
$\frac{\partial z}{\partial y}$	Partial derivative of z with respect to y	-
$F_{y}, F_{z}$	Partial derivatives of implicit function F	-

Where

F_x

F_y

, and

F_z

are the partial derivatives of the function

F

with respect to each variable, assuming

F_z \neq 0

The Gradient Vector

The gradient of a function

f(x, y)

is a vector consisting of its partial derivatives. It plays a crucial role in determining the direction of steepest ascent on a surface.

The Gradient

For a function $f(x, y)$ , the gradient, denoted by $\nabla f(x, y)$ (read "del f"), is the vector:

The Gradient Vector

Vector of partial derivatives.

\nabla f(x, y) = \left\langle f_x(x, y), f_y(x, y) \right\rangle

Variables

Symbol	Description	Unit
$\nabla f(x, y)$	Gradient vector of f	-
$f_{x}, f_{y}$	Partial derivatives of f	-

Key Properties:

The gradient vector points in the direction of the maximum rate of increase of the function.
The magnitude of the gradient vector, $|\nabla f|$ , gives the maximum rate of increase in that direction.
The gradient vector is always perpendicular (orthogonal) to the level curves of the function.

Directional Derivatives

The gradient tells us the rate of change in the directions of the axes and the direction of maximum change. But what if we want to know the rate of change in an arbitrary direction? The directional derivative provides this.

Directional Derivative

The directional derivative of $f(x, y)$ in the direction of a unit vector $\mathbf{u} = \langle u_1, u_2 \rangle$ is defined as the dot product of the gradient and the unit vector:

Directional Derivative

Rate of change in an arbitrary direction.

D_{\mathbf{u}}f(x, y) = \nabla f(x, y) \cdot \mathbf{u} = f_x(x, y)u_1 + f_y(x, y)u_2

Variables

Symbol	Description	Unit
$D_{\mathbf{u}}f(x, y)$	Directional derivative in direction u	-
$\nabla f(x, y)$	Gradient vector	-
$\mathbf{u}$	Unit direction vector	-

Interact with the simulation below to explore directional derivatives and gradient vectors on a contour map, illustrating steepest ascent and orthogonal level curves.

Gradient Vector Visualization

Surface: f(x, y) = x² + y²

Current State

Position (x, y)(0.00, 0.00)

∇f = <2x, 2y><0.00, 0.00>

Magnitude |∇f|0.00

Move your mouse over the grid. Notice how the red gradient vector always points directly outward from the origin, perpendicular to the circular level curves. This shows the direction of steepest ascent on the paraboloid surface.

Total Differentials

The total differential

dz

approximates the total change in

z

due to small simultaneous changes in

x

(

dx

) and

y

(

dy

Total Differential

Approximate total change in z.

dz = \frac{\partial z}{\partial x} dx + \frac{\partial z}{\partial y} dy

Variables

Symbol	Description	Unit
$d z$	Total differential of z	-
$\frac{\partial z}{\partial x}, \frac{\partial z}{\partial y}$	Partial derivatives	-
$d x, d y$	Differentials of independent variables	-

This is fundamental in error analysis for experiments with multiple measured variables.

Key Takeaways

Partial Derivatives measure the rate of change with respect to one variable while holding others constant. Geometrically, they represent the slopes of tangent lines in the x and y directions.
The Second Partials Test classifies critical points on surfaces as local max, min, or saddle points using the Hessian discriminant.
Lagrange Multipliers optimize multivariable functions subject to constraint equations.
The Chain Rule for multivariable functions sums the contributions from each intermediate variable.
The Gradient Vector points in the direction of steepest ascent and its magnitude gives the maximum rate of change. It is orthogonal to level curves.
Total Differentials approximate changes in multivariable functions, useful for total error estimation.

PreviousDifferentials and Approximations - Examples & Applications

Quiz Me

NextPartial Differentiation - Examples & Applications