Lecture3 4
Lecture3 4
Lecture 3
ELE 301: Signals and Systems Today’s topics
Impulse response
Prof. Paul Cuff Extended linearity
Slides courtesy of John Pauly (Stanford) Response of a linear time-invariant (LTI) system
Convolution
Princeton University
Zero-input and zero-state responses of a system
Fall 2011-12
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 1 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 2 / 55
Impulse Response
The impulse response of a linear system hτ (t) is the output of the system Note: Be aware of potential confusion here:
at time t to an impulse at time τ . This can be written as When you write
hτ (t) = H(δτ (t))
hτ = H(δτ )
the variable t serves different roles on each side of the equation.
Care is required in interpreting this expression!
t on the left is a specific value for time, the time at which the output
δ(t) is being sampled.
h(t, 0)
t on the right is varying over all real numbers, it is not the same t as
0 t 0 t on the left.
H The output at time specific time t on the left in general depends on
δ(t − τ) h(t, τ) the input at all times t on the right (the entire input waveform).
0 τ t 0 t
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 3 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 4 / 55
Assume the input impulse is at τ = 0,
Time-invariance
If H is time invariant, delaying the input and output both by a time τ
h = h0 = H(δ0 ). should produce the same response
h(2) = H(δ(2)) ⇐ No! In this case, we don’t need to worry about hτ because it is just h shifted in
time.
First, δ(2) is something like zero, so H(0) would be zero. Second, the
value of h(2) depends on the entire input waveform, not just the δ(t)
value at t = 2. h(t)
0 t 0 t
H 0 H
δ(t) δ(t − τ)
δ(2) h(t, 0) h(2, 0) h(t − τ)
0 2 t 0 2 t 0 τ t 0 t
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 5 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 6 / 55
Linearity: A system S is linear if it satisfies both Summation: If yn = Sxn for all n, an integer from (−∞ < n < ∞),
and an are constants
Homogeneity: If y = Sx, and a is a constant then !
X X
an yn = S an x n
ay = S(ax).
n n
Superposition: If y1 = Sx1 and y2 = Sx2 , then Summation and the system operator commute, and can be
interchanged.
y1 + y2 = S(x1 + x2 ). Integration (Simple Example) : If y = Sx,
Combined Homogeneity and Superposition: Z ∞ Z ∞
If y1 = Sx1 and y2 = Sx2 , and a and b are constants, a(τ )y (t − τ ) dτ = S a(τ )x(t − τ )dτ
−∞ −∞
ay1 + by2 = S(ax1 + bx2 ) Integration and the system operator commute, and can be
interchanged.
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 7 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 8 / 55
Output of an LTI System
Applying the system H to the input x(t),
We would like to determine an expression for the output y (t) of an linear y (t) = H (x(t))
time invariant system, given an input x(t) Z ∞
= H x(τ )δτ (t)dτ
−∞
x y
H If the system obeys extended linearity we can interchange the order of the
system operator and the integration
Z ∞
y (t) = x(τ )H (δτ (t)) dτ.
We can write a signal x(t) as a sample of itself −∞
Z ∞
The impulse response is
x(t) = x(τ )δτ (t) dτ
−∞
hτ (t) = H(δτ (t)).
This means that x(t) can be written as a weighted integral of δ functions.
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 9 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 10 / 55
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 11 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 12 / 55
System Equation Solutions for the System Equation
The System Equation relates the outputs of a system to its inputs.
Example from last time: the system described by the block diagram Solving the system equation tells us the output for a given input.
The output consists of two components:
x +
Z y
+ The zero-input response, which is what the system does with no input
-
at all. This is due to initial conditions, such as energy stored in
capacitors and inductors.
a
x(t) = 0 y(t)
0 t 0 t
has a system equation H
0
y + ay = x.
In addition, the initial conditions must be given to uniquely specify a
solution.
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 13 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 14 / 55
The zero-state response, which is the output of the system with all
initial conditions zero.
x(t) y(t) Example: Solve for the voltage across the capacitor y (t) for an arbitrary
input voltage x(t), given an initial value y (0) = Y0 .
0 t 0 t
H
i(t) R
If H is a linear system, its zero-input response is zero. Homogeneity +
states if y = F (ax), then y = aF (x). If a = 0 then a zero input x(t) +
−
C y(t)
−
requires a zero output.
x(t) = 0 y(t) = 0
0 t 0 t
H
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 15 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 16 / 55
To solve for the total response, we let the undetermined coefficient be a
From Kirchhoff’s voltage law
function of time
x(t) = Ri(t) + y (t) y (t) = A(t)e −t/RC .
Substituting this into the differential equation
Using i(t) = Cy 0 (t)
RCy 0 (t) + y (t) = x(t). 1
RC A0 (t)e −t/RC − A(t)e −t/RC + A(t)e −t/RC = x(t)
This is a first order LCCODE, which is linear with zero initial conditions. RC
First we solve for the homogeneous solution by setting the right side (the Simplifying
1 t/RC
input) to zero A0 (t) = x(t) e
RCy 0 (t) + y (t) = 0. RC
which can be integrated from t = 0 to get
The solution to this is
y (t) = Ae −t/RC Z t
1 τ /RC
A(t) = x(τ ) e dτ + A(0)
which can be verified by direct substitution. 0 RC
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 17 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 18 / 55
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 19 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 20 / 55
Example: Output is superposition of impulse responses (light).
High energy photon detectors can be modeled as having a simple
exponential decay impulse response.
Input: Photons Output: Light
Doshi et al.: LSO PET detector 1540
The response of an LTI system is completely characterized by its x(t) y(t) x(t) y(t)
impulse response h(t). ∗h(t) ∗h(t)
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 23 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 24 / 55
Superposition Integral for Causal Systems LTI System Response to a Sinusoidal Input
A LTI system has a real impulse response h(t). A sinusoidal input
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 25 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 26 / 55
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 27 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 28 / 55
Summary
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 29 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 30 / 55
The convolution of an input signal x(t) with and impulse response h(t) is
Z ∞
y (t) = x(τ )h(t − τ ) dτ
−∞
Review: response of an LTI system = (x ∗ h)(t)
Representation of convolution
Graphical interpretation or
Examples y = x ∗ h.
Properties of convolution
This is also often written as
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 31 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 32 / 55
Convolution Integral for Causal Systems τ <t τ >t
Does not
x(t) y(t) contribute to y(t)
0 τ t 0 t
Z ∞
! t
For a causal system h(t) = 0 for t < 0, and x(t) = x(τ)δ(t − τ)dτ y(t) = x(τ )h(t − τ )dτ
−∞ −∞
Z ∞
y (t) = x(τ )h(t − τ ) dτ.
−∞ If x(t) is also causal, x(t) = 0 for t < 0, and the integral further simplifies
Z t
Since h(t − τ ) = 0 for t < τ , the upper limit of the integral is t
y (t) = x(τ )h(t − τ ) dτ.
Z t 0
y (t) = x(τ )h(t − τ )dτ.
−∞ Does not
contribute to y(t) τ <t τ >t
Does not
Only past and present values of x(τ ) contribute to y (t). x(t) y(t) contribute to y(t)
0 τ t 0 t
! t ! t
x(t) = x(τ )δ(t − τ )dτ y(t) = x(τ )h(t − τ )dτ
0 0
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 33 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 34 / 55
Graphical Interpretation
This is multiplied point by point with the input,
An increment in input x(τ )δτ (t)dτ produces an impulse response x(τ )
h(t − τ ) x(τ )h(t − τ )
x(τ )hτ (t)dτ . The output is the integral of all of these responses
Z ∞
y (t) = x(τ )hτ (t) dτ t τ t τ
−∞
Then integrate over τ to find y (t) for this t.
Another perspective is just to look at the integral.
Graphically, to find y (t):
hτ (t) = h(t − τ ) is the impulse response delayed to time τ
If we consider h(t − τ ) to be a function of τ , then h(t − τ ) is delayed flip impulse response h(τ ) backwards in time (yields h(−τ ))
to time t, and reversed. drag to the right over t (yields h(−(τ − t)))
h(t − τ ) h(t − τ ) multiply pointwise by x (yields x(τ )h(t − τ ))
Z ∞
integrate over τ to get y (t) = x(τ )h(t − τ ) dτ
τ t t τ −∞
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 35 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 36 / 55
Simple Example
2 2
x(τ) x(τ) x(τ)
h(t − τ) t <0 h(t − τ)
1 1 1 0<t <1
-1 0 1 2 3 τ 0 3 τ 0 3 τ
-1 1 2 -1 1 2
2
2
1 h(τ) x(τ) x(τ)
h(t − τ) 1<t <2 2<t <3
1 1 h(t − τ)
-1 0 1 2 3 τ
-1 0 1 2 3 -1 0 1 2 3 τ
2
h(−τ) y(t) = (x ∗ h)(t)
1 2
2
x(τ)
1 h(t − τ) t >3 1
-1 0 1 2 3τ
2 -1 0 1 2 3 τ -1 0 1 2 3 τ
h(t − τ)
1
-1 0 1 2 3τ
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 37 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 38 / 55
Communication channel, e.g., twisted pair cable Simple signaling at 0.5 bit/sec; Boolean signal 0, 1, 0, 1, 1, . . .
x(t) y(t)
∗h(t)
1
x(t)
0.5
u
Impulse response: 0
0 2 4 6 8 10
1.5
tt
1
y(t)
1 h(t)
0.5
y
h
0
0.5
0 2 4 6 8 10
tt
0
0 2 4 6 8 10
tt Output is delayed, smoothed version of input.
0.5 0 1 2
u
0 1 2 0 1 2
0
1 1 1
0 2 4 6 8 10
t 0 1 2 0 1 2 0 1 2
1 y(t)
δ(t − 1)
1 1 1
0.5
y
0 1 2 0 1 2 0 1 2
0
0 2 4 6 8 10 1 1 1
tt
0 1 2 0 1 2 0 1 2
Smoothing makes 1’s & 0’s very hard to distinguish in y .
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 41 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 42 / 55
Properties of Convolution
Simple Example (x*h)
For any two functions f and g the convolution is
2 2
Z ∞ x(τ)
1 1 h(τ)
(f ∗ g )(t) = f (τ )g (t − τ ) dτ
−∞
-1 0 1 2 3 τ -1 0 1 2 3 τ
If we make the substitution τ1 = t − τ , then τ = t − τ1 , and dτ = −dτ1 .
Z −∞ 2 h∗x 2
x∗h x(τ)
(f ∗ g )(t) = f (t − τ1 )g (τ1 ) (−dτ1 ) h(t − τ) 1
x(t − τ)
1
Z∞∞ h(τ)
= g (τ )f (t − τ1 ) dτ1 -1 0 1 2 3 τ -1 0 1 2 3 τ
−∞
= (g ∗ f )(t) y(t) = (x ∗ h)(t)
2
1
This means that convolution is commutative.
Practically, If we have two signals to convolve, we can choose either to be -1 0 1 2 3 τ
the signal we hold constant and the other to ”flip and drag.”
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 43 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 44 / 55
Convolution is associative Linearity
Convolution is also distributive,
f ∗ (g + h) = f ∗ g + f ∗ h
If we convolve three functions f , g , and h
which is easily shown by writing out the convolution integral,
(f ∗ (g ∗ h))(t) = ((f ∗ g ) ∗ h)(t) Z ∞
(f ∗ (g + h))(t) = f (τ ) [g (t − τ ) + h(t − τ )] dτ
which means that convolution is associative. Z−∞ Z ∞
∞
Combining the commutative and associate properties, = f (τ )g (t − τ ) dτ + f (τ )h(t − τ ) dτ
−∞ −∞
f ∗ g ∗ h = f ∗ h ∗ g = ··· = h ∗ g ∗ f = (f ∗ g )(t) + (f ∗ h)(t)
We can perform the convolutions in any order. Together, the commutative, associative, and distributive properties mean
that there is an “algebra of signals” where
Convolution systems are linear: for all signals x1 , x2 and all α, β ∈ <,
Convolution with a delayed signal gives a delayed output. h ∗ (αx1 + βx2 ) = α(h ∗ x1 ) + β(h ∗ x2 )
(f ∗ gτ )(t) = (fτ ∗ g )(t) = (f ∗ g )(t − τ ) Convolution systems are time-invariant: if we shift the input signal x
by T , i.e., apply the input
x1 (t) = x(t − T )
y1 (t) = y (t − T ).
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 47 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 48 / 55
Composition of convolution systems corresponds to convolution of Since convolution is commutative, the convolution systems are also
impulse responses. commutative. These two cascade connections have the same response
The cascade connection of two convolution systems y = (x ∗ f ) ∗ g
Composition y
x w
∗f ∗g
x w y
∗f ∗g
x v y
∗g ∗f
is the same as a single system with an impulse response h = f ∗ g
x y
∗( f ∗ g) Many operations can be written as convolutions, and these all commute
(integration, differentiation, delay, ...)
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 49 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 50 / 55
s(t) 0 t 0 t 0 t
u(t) d
∗h
0 t 0 t dt
∗h
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 51 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 52 / 55
Convolution Systems with Complex Exponential Inputs
If we have a convolution system with an impulse response h(t), and
and input e st where s = σ + jω
Z ∞
H(s) is the transfer function of the system.
y (t) = h(τ )e s(t−τ ) dτ
−∞ If the input is a complex sinusoid e jωt ,
Z ∞
Z ∞
= e st h(τ )e −sτ dτ
−∞ H(jω) = h(τ )e −jωτ dτ
−∞
We get the complex exponential back, with a complex constant y (t) = e jωt H(jω)
multiplier
Z ∞
H(s) = h(τ )e −sτ dτ
−∞
y (t) = e st H(s)
Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 53 / 55 Cuff (Lecture 3) ELE 301: Signals and Systems Fall 2011-12 54 / 55
Summary