Laplace Fourier 3
Laplace Fourier 3
XU WANG
These notes for TMA4135 (first seven weeks) are based on Erwin Kreyszig’s book [2], Dag Wessel-
Berg’s video: http://video.adm.ntnu.no/serier/4fe2d4d3dbe03, and references [1, 3, 4] (among them
[1] is very short and readable).
C ONTENTS
1. Laplace transform 1
1.1. Basic facts 1
1.2. Laplace transform of derivatives, ODEs 2
1.3. More Laplace transforms 3
2. Fourier analysis 9
2.1. Complex and real Fourier series 9
2.2. Fourier Sine and Cosine series 13
2.3. More Fourier series 14
2.4. Fourier transform 17
2.5. Fourier inversion formula 18
2.6. More Fourier transforms 20
3. Partial differential equations 21
3.1. Functions of several variables 21
3.2. Solve wave equation by Fourier series 23
3.3. Solve heat equation by Fourier series 25
3.4. Solve heat equation by Fourier transform 26
4. Appendix: Definition of e, π and Euler’s formula 27
4.1. Where does e come from ? 27
4.2. Definition of the exponential function 28
4.3. Definition of π and trigonometric functions 29
References 30
1. L APLACE TRANSFORM
1.1. Basic facts.
Definition 1.1. Let f (t), t ≥ 0 be a given function. We call
Z ∞
F (s) := e−st f (t) dt,
0
the Laplace transform of f (t) and write
F = L(f ), f = L−1 F.
Date: September 25, 2018.
1
2 XU WANG
Remark: One can prove that the Laplace transform L is injective (see page 9 in [1]), that is the
reason why L−1 is well defined (for a precise formula of L−1 , see page 10 in [1]). To compute Laplace
transforms, we need:
Z b
(1) d(f g) = f dg + gdf, df = f (b) − f (a),
a
where df := f 0 (t)dt.
Example 1:
1 1
(2) L(1) = , L−1 ( ) = 1, s > 0.
s s
Example 2:
1 1
(3) L(ekt ) = , L−1 ( ) = ekt , s > k.
s−k s−k
2
Example 3: L(et ) does not exist,
Z ∞
2
e−st et dt = ∞,
0
for all real number s.
Remark: Laplace transform is linear: By linearity, we mean for all real numbers a, b,
(4) L(af + bg) = aL(f ) + bL(g).
Application 1:
5(s − 3)
L(3 + 2e5t ) = 3L(1) + 2L(e5t ) = , s > 5.
s−5
Application 2: Since
1 1 1 1
= = − .
s2 − 3s + 2 (s − 1)(s − 2) s−2 s−1
linearity gives
1 1 1
L−1 ( ) = L−1 ( ) − L−1 ( ) = e2t − et .
s2 − 3s + 2 s−2 s−1
n!
Proposition 1.2. L(tn ) = sn+1
, for n = 1, 2, · · · , and s > 0.
1.2. Laplace transform of derivatives, ODEs.
Theorem 1.3 (Laplace transform of the derivative).
L(f 0 ) = sL(f ) − f (0).
Example: Solve:
y 0 = y, y(0) = 1.
The answer is
y(t) = et .
Remark: Apply the theorem to f 0 , we get
L(f 00 ) = sL(f 0 ) − f 0 (0) = s(sL(f ) − f (0)) − f 0 (0) = s2 L(f ) − sf (0) − f 0 (0).
LAPLACE TRANSFORM AND FOURIER TRANSFORM 3
s
1. Find the inverse Laplace transform of s2 +2s+2
. The answer is
s
L−1 ( ) = e−t (cos t − sin t).
s2 + 2s + 2
Exercises:
1. Show that
−1 1
L 2
= 1 − cos t.
s(s + 1)
2. Show that
−1 1 1
L · = et − 1 − t.
s s(s − 1)
LAPLACE TRANSFORM AND FOURIER TRANSFORM 5
RC-Circuit equation (see page 29 section 1.5 and page 93 section 2.9 of Kreyszig’s book): R, C
postive constants, i(t), e(t) functions:
1 t
Z
Ri(t) + i(τ ) dτ = e(t).
C 0
Apply the Laplace transform, we get
1 I(s)
RI(s) + · = E(s),
C s
6 XU WANG
i.e.
E(s) s E(s)
I(s) = 1 = 1 .
R + Cs s + RC R
Exercise:
2. Compute i(t) when
e(t) = u(t − 1) − u(t − 2), R = C = 1.
Answer
i(s) = u(t − 1)e−(t−1) − u(t − 2)e−(t−2) .
Exercise: solve
y 00 + y = δ(t − 1), y(0) = y 0 (0) = 0.
Answer
y = L−1 (e−s L(sin t)) = u(t − 1) sin(t − 1).
Examples:
t2
1?t= ,
2
et ? et = tet ,
Z t
f (t) ? 1 = f (τ ) dτ.
0
Exercises:
1. Compute tm ? tn . Hint: use tm ? tn = L−1 L(tm ? tn ), answer
m!n!
tm ? tn = tm+n+1 , m, n = 0, 1, · · ·
(m + n + 1)!
1 sin t − t cos t
L−1 ( )= .
(s2 + 1) 2 2
et + e−t
y= = cosh t.
2
Example: Consider
y 00 + y = r(t), y(0) = y 0 (0) = 0.
Apply the Laplcae transform, we have
s2 Y + Y = L(r).
Thus
1
Y = · L(r),
s2 +1
which gives
y(t) = sin t ? r.
8 XU WANG
Y1 + (s + 1)Y2 = F (s).
The first equation gives Y2 = (s + 1)Y1 , together with the second, we have
Y1 = F (s)(1 + (s + 1)2 )−1 .
Use the first equation again,
Y2 = F (s)(s + 1)(1 + (s + 1)2 )−1 .
Thus
y1 = f (t) ? (e−t sin t), y2 = f (t) ? (e−t cos t).
when f (t) = e−t , we get
Z t
y1 = e−(t−τ ) e−τ sin τ dτ = e−t (1 − cos t), y2 = e−t sin t.
0
LAPLACE TRANSFORM AND FOURIER TRANSFORM 9
2. F OURIER ANALYSIS
2.1. Complex and real Fourier series.
2.1.1. Complex Fourier series. Fix p > 0, if
f (x + p) = f (x), ∀ x ∈ R,
then call f a periodic function with period p.
Example: periodic function:
1. A polynomial is periodic if and only if it is a constant;
2. eλx has period 2π if and only if λ = in, n ∈ Z.
The main theorem in Fourier analysis is the following:
Theorem 2.1 (Fourier 1807). If f has period 2π and is smooth enough then we have
X
f (x) = cn einx , ∀ x ∈ R.
n∈Z
——The proof (see Page 63 in [3]) is not assumed in this course.
What does "smooth enough" mean? It means that f is piecewise smooth and
f (x0 +) + f (x0 −)
f (x0 ) = ,
2
if f is not smooth at x0 .
How to compute cn ? We shall prove that
Z π
1
cn = f (x)e−inx dx.
2π −π
In fact , by the above theorem, we have
Z π X cm Z π
1
f (x)e−inx dx = eimx e−inx dx.
2π −π 2π −π
m∈Z
If m = n then Z π Z π
imx −inx
e e dx = 1 dx = 2π.
−π −π
10 XU WANG
If m 6= n then
π π
ei(m−n)x
Z Z
i(m−n)x
e dx = d( ) = 0.
−π −π i(m − n)
Thus
X cm Z π
eimx e−inx dx = cn .
2π −π
m∈Z
Example: Consider
and
f (0) = f (π) = f (−π) = 0.
Then we know f is smooth enough and
Z π Z π Z 0
−inx −inx
2πcn = f (x)e dx = e dx − e−inx dx.
−π 0 −π
Since
π π
e−inx (−1)n − 1
Z Z
−inx
e dx = d( )= ,
0 0 −in −in
and
0 0
e−inx 1 − (−1)n
Z Z
−inx
e dx = d( )= ,
−π −π −in −in
we have
2(1 − (−1)n )
2πcn = ,
in
i.e.
2
cn =
, n odd; cn = 0, n even.
inπ
Thus the complex fourier series of f is
X 2
f (x) = ei(2m+1)x .
i(2m + 1)π
m∈Z
LAPLACE TRANSFORM AND FOURIER TRANSFORM 11
Example: Consider
f (x) = 0, −π < x < 0; f (x) = x, 0 ≤ x < π.
Then
π π
π2
Z Z
2πa0 = f (x) dx = x dx = ,
−π 0 2
and
Z π Z π Z π Z π
sin nx sin nx
πan = f (x) cos nx dx = x cos nx dx = x d( )=− dx.
−π 0 0 n 0 n
Since
π π
(−1)n − 1
Z Z
sin nx cos nx
− dx = d( ) = ,
0 n 0 n2 n2
we get
π −2
a0 = , a2m = 0, a2m−1 = , m = 1, 2 · · · .
4 (2m − 1)2 π
Moreover, we have
Z π π π π
− cos nx π(−1)n+1
Z Z Z
cos nx
πbn = f (x) sin nx dx = x sin nx dx = x d( )= + dx,
−π 0 0 n n 0 n
Notice that Z π Z π
cos nx sin nx
dx = d( ) = 0,
0 n 0 n2
thus
(−1)n+1
bn = .
n
Thus
π 2 cos 3x sin 2x sin 3x
f (x) = − cos x + + · · · + sin x − + + ··· .
4 π 32 2 3
Take x = 0 then we get
π 2 1
0= − (1 + 2 + · · · ),
4 π 3
i.e.
1 1 π2
1+ + + · · · = .
32 52 8
1 1 π2
Exercise: Use 1 + 32
+ 52
+ ··· = 8 to prove that
1 1 π2
1+ + + · · · = .
22 32 6
LAPLACE TRANSFORM AND FOURIER TRANSFORM 13
Odd or Even extension: Let f be a function in (0, π). Then we can extend f to an odd function,
say fo such that
fo (−x) = −f (x), x ∈ (0, π);
we can also extend f to an even function, say fe such that
fe (−x) = f (x), x ∈ (0, π).
Exercise:
1. Draw the graph of the odd extension fo and the even extension fe of the following function
π π π
f (x) = x, 0 < x < ; f (x) = , < x < π.
2 2 2
2. Find the Fourier cosine series of fe . Answer
3π 2 2 cos 2x cos 3x cos 5x
fe (x) = + − cos x − − − − ··· .
8 π 22 32 52
3. Find the Fourier sine series of fo . Answer
2 1 −2 1
fo (x) = + 1 sin x + 0 − sin 2x + + sin 3x
π 2 32 π 3
1 2 1
+ 0− sin 4x + 2
+ sin 5x + · · · .
4 5 π 5
2.3. More Fourier series.
2.3.1. Parseval’s identity. Let f be a smooth enough function with period 2π. Consider the complex
Fourier series expansion of f
X
f= cn einx .
n∈Z
We have Z π Z π X
2
|f (x)| dx = cn cm einx−imx dx.
−π −π n,m∈Z
Assume that
∞
X
γ(t) = an cos nt + bn sin nt,
n=0
then we call
y(t) := y0 + y1 + · · · + yn + · · · ,
a steay state solution of (??). When ω = N is a natural number, avoid resonance means that the input
γ(t) satisfies aN = bN = 0.
16 XU WANG
Now S is the subspace of V spanned by einx , |n| ≤ N . Let f be a smooth enough function with
period 2π. Then we know that
||fS − f || = min{||u − f || : u ∈ S}
Thus FN = fS (recall that fS means the orthogonal projection of f to S) solves our extremal problem.
What is fS ? The simplest way is to use the complex Fourier series expansion
X
f (x) = cn einx .
n∈Z
Put X
fN = cn einx ,
|n|≤N
Theorem 2.8. Complex Fourier series expansion solves the best L2 –approximation by inx
P
|n|≤N cn e
problem problem.
Bessel’s inequality and Parseval’s identity: Notice that (try!)
||f ||2 = ||fN ||2 + ||f − fN ||2 ,
Thus we get the Bessel inequality
||f ||2 ≥ ||fN ||2 ,
i.e. Z π X
|f (x)|2 dx ≥ 2π · |cn |2 ,
−π |n|≤N
and the Parseval identity Z π X
|f (x)|2 dx = 2π · |cn |2 .
−π n∈Z
Example: F2: Fourier transform of f (x) = e−x if x > 0 and f (x) = 0 otherwise:
Z ∞ Z ∞
1 −iwx 1 1
ˆ
f (w) := √ f (x)e dx = √ e−x e−iwx dx = √ L(e−iwt )(1).
2π −∞ 2π 0 2π
Recall that
1
L(e−iwt )(s) = ,
s + iw
thus
1 1
fˆ(w) = √ · .
2π 1 + iw
18 XU WANG
2.4.1. From Complex Fourier series to inverse Fourier transform. : Assume that f is smooth enough
in −N < x < N and f = 0 when |x| > N . For each L > N , let us define a periodic function fL
such that
fL (x) = f (x), |x| < L; fL (x + 2L) = fL (x).
Then we know that
Lx
gL (x) = fL ,
π
has period 2π and is smooth enough. Thus
Z π
X 1
gL (x) = cn einx , cn = gL (x)e−inx dx.
2π −π
Thus πx X πx
fL (x) = gL = cn ein L .
L
Consider v = Lxπ , we can write
Z L Z ∞ √
1 −in πv πv 1 −in πv 2π ˆ nπ
cn = fL (v)e L d( )= f (v)e L dv = f ( ).
2π −L L 2L −∞ 2L L
which gives
in πx
π X fˆ( nπ
r
L )·e
L
f (x) = .
2 L
n∈Z
Put
π
∆w = ,
L
then we have
1 Xˆ
f (x) = √ f (n∆w) · eix·n∆w ∆w.
2π n∈Z
Assume that fˆ(w)eixw is integrable in −∞ < x < ∞. Let L goes to infty, the above formula gives
the following Fourier inversion formula:
Z ∞
1
f (x) = √ fˆ(w)eixw dw.
2π −∞
We say that f (x) is the inverse Fourier transform of fˆ(w) and write f = F −1 (fˆ).
2.5. Fourier inversion formula. When do we have the Fourier inversion formula ? It is known that
(see Page 141 Theorem 1.9 in [3]) the Fourier inversion formula is true if f is smooth and rapidly
decreaing, in the sense that
sup |x|k |f (l) (x)| < ∞, for every k, l ≥ 0,
x∈R
x2 x2
Notice that (e− 2 )0 = e−
(−x), thus
2
Z ∞ Z ∞
0 i −iwx − x2
2 −i x2
ˆ
f (w) = √ e d(e )= √ e− 2 d(e−iwx ) = −wfˆ(w).
2π −∞ 2π −∞
Now we have
0
w2 w2
fˆ(w)e 2 = (−w + w) fˆ(w)e 2 = 0.
w 2
Thus fˆ(w)e 2 is a constant, i.e.
w 2
fˆ(w)e 2 ≡ fˆ(0)e0 = fˆ(0).
Now we have
−w 2
fˆ(w) = fˆ(0)e 2 = fˆ(0)f (w)
Step 2: The Fourier inversion formula implies (notce that f is smooth and rapidly decreasing)
we get
fˆ(0) = 1, fˆ = f.
(one may also use integration on R2 to compute the following integral directly, see page 138 formula
(6) in [3]), consider
√
u = tx + µ, t > 0, µ ∈ R,
then (7) becomes the following classical formula in Gauss’s normal distribution theory
Z ∞
1 (u−µ)2
(8) √ e− 2t du = 1,
−∞ 2πt
where
1 (u−µ)2
(9) f (u | µ, t) := √ e− 2t ,
2πt
is the probability density of the normal distribution with expectation µ and variance t.
20 XU WANG
2.5.2. Inverse Laplace transform. Recall the definition of the Laplace transform
Z ∞
F (s) = e−st f (t) dt
0
Extend f to a function on R such that
f (x) = 0, ∀ x < 0.
Thus we have Z ∞
F (s) = e−st f (t) dt,
−∞
which gives √
F (iw) = 2π fˆ(w).
Thus the Fourier inversion formula gives
Z ∞ Z ∞
1 ˆ itw 1
Laplace inversion formula : f (t) = √ f (w)e dw = F (iw)eitw dw.
2π −∞ 2π −∞
2.6. More Fourier transforms.
2.6.1. Derivative and convolution formulas in Fourier transform. In this section, we only consider
functions that are smooth and rapidly decreasing. The main result is the following:
R∞
Theorem 2.10. Let F(f )(w) = √12π −∞ f (x)e−iwx dx be the Fourier transform of f . Then
1) F(af + bg) = aF(f ) + bF(g);
2) F(f 0 ) = iwF(f );
3) (F(f ))0 = −iF(xf (x)).
Proof. We only prove 2). Notice that
Z ∞ Z ∞ Z ∞ Z ∞
0 −iwx −iwx −iwx
f (x)e dx = e df = d(e f) − f (x) d(e−iwx ).
−∞ −∞ −∞ −∞
Since f is smooth and repadly decreasing, we have
Z ∞
d(e−iwx f ) = lim e−iwx f (x) − lim e−iwx f (x) = 0.
−∞ x→∞ x→−∞
Thus Z ∞ Z ∞ Z ∞
0 −iwx −iwx
f (x)e dx = − f (x) d(e ) = iw f (x)e−iwx dx,
−∞ −∞ −∞
which implies 2).
2 2
− x2 − w2
Example: F(xe ) = −iwe : By 3), we have
2 x2 w2 w2
− x2
F(xe ) = i(F(e− 2 ))0 = i(e− 2 )0 = −iwe− 2 .
Convolution: Let us first recall the definition of convolution for functions f, g defined on [0, ∞):
Z t
(f ? g)(t) := f (τ )g(t − τ ) dτ.
0
Notice that if we extend f, g to functions on R such that
f = g = 0, when x ≤ 0.
LAPLACE TRANSFORM AND FOURIER TRANSFORM 21
3.1.2. Partial derivatives. x-partial derivative of f (x, y) means derivative of f with y fixed:
∂f f (x + h, y) − f (x, y)
(x, y) := lim ,
∂x h→0 h
we write
∂f ∂fx
fx := , fxy := .
∂x ∂y
Example: If
1 x2
f (t, x) = √ e− 2t ,
2πt
then
1 −1 −3 − x2 1 x2 −x2 −1 x2 − t
ft = √ · · t 2 · e 2t + √ e− 2t · · 2 = f,
2π 2 2πt 2 t 2t2
and
x 1 x2 x2 − t
fx = − f, fxx = − f + 2 f = f.
t t t t2
Thus we get that
1
(11) ft = fxx .
2
3.1.3. Directional derivative and gradient. Let n in the unit sphere be a given direction, then we call
f (p + hn) − f (p)
fn (p) := lim ,
h→0 h
the derivative of f along direction n at p. If we write
n = (a, b, c), p = (x, y, z),
then
f (x + ah, y + bh, z + ch) − f (x, y, z)
fn (p) = lim .
h→0 h
Example: If
f (x, y, z) = c0 + c1 x + c2 y + c3 z,
then
f (hn) = f (ah, bh, ch) = c0 + (c1 a + c2 b + c3 c)h,
which gives
(12) fn (0) = c1 a + c2 b + c3 c = (fx (0), fy (0), fz (0)) · n.
Definition 3.1. We call
∇f (p) := (fx1 (p), · · · , fxm (p)),
the gradient of f (x1 , · · · , xm ) at p.
LAPLACE TRANSFORM AND FOURIER TRANSFORM 23
Step 2: Solve the ODE and fit the initial condition: The general solution is
−w2
t
F(u)(t, w) = c(w)e 2 .
Notice that our initial condition implies
Z ∞
1
F(u)(0, w) = √ f (x)e−ixw dx = F(f ).
2π −∞
Thus
c(w) = F(f ).
Now we have
−w2
F(u)(t, w) = F(f ) · e 2 t .
Step 3: use Fourier convolution formula: Recall that (see (6))
Z ∞
−u2 1 −y 2
e 2 =√ e 2 e−iyu dy.
2π −∞
Take √ x
u = w t, y = √ ,
t
we get Z ∞
−w2 1 −x2 1 −x2
e 2
t
= √ e 2t e−ixw dx = √ F(e 2t ).
2πt −∞ t
Thus
1 −x2
F(u)(t, w) = F(f ) · √ F(e 2t )
t
Now the Fourier convolution formula gives
Z ∞
1 −x2 1 −(x−p)2
u(t, x) = √ (f ? e 2t ) = f (p) √ e 2t dp,
2πt −∞ 2πt
Summary: the solution u(t, x) is given by convolution of the initial temperature distribution with
the heat kernel.
R EFERENCES
[1] B. Berndtsson, Fourier and Laplace transforms, can be found in:
www.math.chalmers.se/Math/Grundutb/CTH/mve025/1718/Dokument/F-analysny.pdf.
[2] E. Kreyszig, Advanced Engineering Mathematics, 10 th edition, internation student version.
[3] E. Stein and R. Shakarchi, Fourier analysis, Princeton lectures in analysis.
[4] A. Vretblad, Fourier Analysis and Its Applications, GTM 233.