Upsampling

Fig 1: Depiction of one dot product, resulting in one output sample (in green), for the case L=4, n=9, j=3. Three conceptual "inserted zeros" are depicted between each pair of input samples. Omitting them from the calculation is what distinguishes a multirate filter from a monorate filter.

Rate increase by an integer factor L can be explained as a 2-step process, with an equivalent implementation that is more efficient:[4]

1. Expansion: Create a sequence, ${\displaystyle x_{L}[n],}$ comprising the original samples, ${\displaystyle x[n],}$ separated by L − 1 zeros.  A notation for this operation is:  ${\displaystyle x_{L}[n]=x[n]_{\uparrow L}.}$
2. Interpolation: Smooth out the discontinuities with a lowpass filter, which replaces the zeros.

In this application, the filter is called an interpolation filter, and its design is discussed below. When the interpolation filter is an FIR type, its efficiency can be improved, because the zeros contribute nothing to its dot product calculations. It is an easy matter to omit them from both the data stream and the calculations. The calculation performed by a multirate interpolating FIR filter for each output sample is a dot product:[lower-alpha 1][upper-alpha 1]

${\displaystyle y[j+nL]=\sum _{k=0}^{K}x[n-k]\cdot h[j+kL],\ \ j=0,1,\ldots ,L-1,}$   and for any ${\displaystyle n}$

(Eq.1)

where the h[•] sequence is the impulse response of the interpolation filter, and K is the largest value of k for which h[j + kL] is non-zero. In the case L = 2, h[•] can be designed as a half-band filter, where almost half of the coefficients are zero and need not be included in the dot products. Impulse response coefficients taken at intervals of L form a subsequence, and there are L such subsequences (called phases) multiplexed together. Each of L phases of the impulse response is filtering the same sequential values of the x[•] data stream and producing one of L sequential output values. In some multi-processor architectures, these dot products are performed simultaneously, in which case it is called a polyphase filter.

For completeness, we now mention that a possible, but unlikely, implementation of each phase is to replace the coefficients of the other phases with zeros in a copy of the h[•] array, and process the ${\displaystyle \scriptstyle x_{L}[n]}$  sequence at L times faster than the original input rate. Then L-1 of every L outputs are zero. The desired y[•] sequence is the sum of the phases, where L-1 terms of the each sum are identically zero.  Computing L-1 zeros between the useful outputs of a phase and adding them to a sum is effectively decimation. It's the same result as not computing them at all. That equivalence is known as the second Noble identity.[5] It is sometimes used in derivations of the polyphase method.

Fig 2: The first triangle of the first graph represents the Fourier transform X(f) of a continuous function x(t). The entirety of the first graph depicts the discrete-time Fourier transform of a sequence x[n] formed by sampling the continuous function x(t) at a low-rate of 1/T. The second graph depicts the application of a lowpass filter at a higher data-rate, implemented by inserting zero-valued samples between the original ones. And the third graph is the DTFT of the filter output. The bottom table expresses the maximum filter bandwidth in various frequency units used by filter design tools.

Let ${\displaystyle X(f)}$ be the Fourier transform of any function, ${\displaystyle x(t),}$ whose samples at some interval, ${\displaystyle T,}$ equal the ${\displaystyle x[n]}$ sequence. Then the discrete-time Fourier transform (DTFT) of the ${\displaystyle x[n]}$ sequence is the Fourier series representation of a periodic summation of ${\displaystyle X(f):}$[lower-alpha 2]

${\displaystyle \underbrace {\sum _{n=-\infty }^{\infty }\overbrace {x(nT)} ^{x[n]}\ e^{-i2\pi fnT}} _{\text{DTFT}}={\frac {1}{T}}\sum _{k=-\infty }^{\infty }X{\Bigl (}f-{\frac {k}{T}}{\Bigr )}.}$

(Eq.2)

When ${\displaystyle T}$ has units of seconds, ${\displaystyle f}$ has units of hertz (Hz). Sampling ${\displaystyle L}$ times faster (at interval ${\displaystyle T/L}$) increases the periodicity by a factor of ${\displaystyle L:}$[lower-alpha 3]

${\displaystyle {\frac {L}{T}}\sum _{k=-\infty }^{\infty }X\left(f-k\cdot {\frac {L}{T}}\right),}$

(Eq.3)

which is also the desired result of interpolation. An example of both these distributions is depicted in the first and third graphs of Fig 2.

When the additional samples are inserted zeros, they decrease the sample-interval to ${\displaystyle T/L.}$ Omitting the zero-valued terms of the Fourier series, it can be written as:

${\displaystyle \sum _{n=0,\pm L,\pm 2L,...,\pm \infty }{}x(nT/L)\ e^{-i2\pi fnT/L},}$

which is equivalent to Eq.2, regardless of the value of ${\displaystyle L.}$ What ${\displaystyle L}$ determines is the DTFT periodicity of a digital filter implemented at the higher data-rate. The second graph depicts a lowpass filter and ${\displaystyle L=3,}$ resulting in the desired spectral distribution (third graph). The filter's bandwidth is the Nyquist frequency of the original ${\displaystyle x[n]}$ sequence.[upper-alpha 2]  In units of Hz that value is ${\displaystyle {\tfrac {0.5}{T}},}$  but filter design applications usually require normalized units. (see Fig 2, table)

Let L/M denote the upsampling factor, where L > M.

1. Upsample by a factor of L
2. Downsample by a factor of M

Upsampling requires a lowpass filter after increasing the data rate, and downsampling requires a lowpass filter before decimation. Therefore, both operations can be accomplished by a single filter with the lower of the two cutoff frequencies. For the L > M case, the interpolation filter cutoff,  ${\displaystyle {\tfrac {0.5}{L}}}$ cycles per intermediate sample, is the lower frequency.

• Downsampling
• Multi-rate digital signal processing
• Half-band filter
• Oversampling
• Sampling (information theory)
• Signal (information theory)
• Data conversion
• Interpolation
• Poisson summation formula

• Tan, Li (2008-04-21). "Upsampling and downsampling". eetimes.com. EE Times. Retrieved 2017-04-10.
• "Digital Audio Resampling Home Page". (discusses a technique for bandlimited interpolation)
• "Matlab example of using polyphase filters for interpolation".