Chris Angove, Independent Chartered Engineer

Electrical Noise

Electrical noise comprises 'unwanted' signals which interfere with the intended operation of electrical equipment designed for 'wanted' signals. Sources of electrical noise are both natural and man-made. Natural noise is generally more predictable and is therefore easier to mitigate for. Man-made noise sources may be unintended or deliberate. Unintended noise may result from insufficient suppression of emissions at the transmitter, insufficient resillience to received noise or a combination of both. The stricter specification is normally placed on the design of the transmission equipment as, in many transmission systems, one noise radiating transmitter can potentially affect large numbers of receivers. However, receiver designers still have responsibility to design reasonable and adequate protection against received noise. The deliberate generation of noise, also known as electronic counter measures (ECM) or 'jamming', is not the subject of this article. Some examples of natural and man-made noise are described below [1] [2] [3] [11].

Additive White Gaussian Noise

The subject of this article is additive white Gaussian noise, a form of naturally generated electrical noise and arguably the most important. It is also known as Johnson, Nyquist, thermal or simply \(k \, T B\) noise, after its well-known equation of the form \(P_N = k \, T B \).

Why is Additive White Gaussian Noise so Important in Communications Engineering?

The Derivation of AWGN from Black Body Radiation

Gaussian Distribution of the Random Noise Voltages

Applying the Auto-correlation Function to AWGN Noise Samples

Why is Additive White Gaussian Noise so Important in Communications and Radar Systems?

Additive white Gaussian noise (AWGN) is generated within the imperfect components used in all electronic electronic circuits [2] [4] [5] [8]. It is present at all temperatures above absolute zero. The mean power level of AWGN is directly proportional to the product of two variables: the absolute temperature of the source and the noise bandwidth of the communications channel(s) which it affects. Therefore, the only measures available to minimise AWGN are: reducing the bandwidth and/or reducing the operating temperature. Its greatest influence is on communications and radar receiving equipment, especially the 'front end' stages where the received signal from an antenna or cable meets its first stage(s) of amplification. It is still present in other electronics hardware, but its relatively small amplitude usually makes it's effect insignificant compared to the signal levels present in normal operation.

The laws of physics tell us that the frequency range of AWGN covers to well in excess of the frequency range of radio equipment that exists with the current technology, to over 100 \(G H z\) [1] [3] [9]. AWGN voltage and phase components are random across frequency, so it cannot be filtered out and it is therefore always present with the signal. The best signal to noise ratio (SNR) performance with AWGN is achieved by minimising the AWGN power and maximising the signal power. The influence of AWGN is therefore greatest in the small signal stages at the front end of a receiver, typically fed by an antenna.

The Derivation AWGN from Black Body Radiation

For a resistor \(R\) ohms (\(\Omega\)) at an absolute temperature \(T \) kelvin (\(K\)), the random and independent motion of large numbers of electrons results in small random voltage fluctuations across the resistor. The AWGN average voltage is zero, but the mean square voltage is finite and proportional to the mean linear power for a given bandwidth. The root mean square (RMS) value of the noise voltage, \(V_n\) volts (\(V\)), is given by Planck's black body radiation law, (2-1) [1] [5].

\[V_n = \sqrt{\frac{4 h f B R}{e^{\frac{h f}{k T}}- 1}} \]
(2-1) The RMS AWGN voltage, derived from Planck's black body radiation law.

where:

Using a math application such as Matlab® or Excel® for example, (2-1) is plotted in Figure 2-1 for some arbitrary values of resistance \(50 \, \Omega\), temperature \(290 \, K\) and noise bandwidth \(1 \, GHz\) and across a frequency range \( 10 \, M H z \) to to \(100\, THz \). The vertical scaling is logarithmic in dB-microvolts (\(d B \mu V\)), defined as \(20 \log_{10} (v_n)\), where \(v_n\) is \(V_n\) expressed in microvolts, so \(v_n = V_n \times 10^6\).

Figure 2-1. The relationship between AWGN RMS voltage and frequency for the parameters shown. This is constant at about 29 \(d B \mu V\) to well past 100 \(G H z \) and the limit of communications equipment functionality with the current technology.

This shows the AWGN RMS noise voltage to be constant at about 29 \(d B \mu V\) to well beyond 100 \(G H z\). In fact, it does not start to fall significantly to well past 1000 \(G H z\). This shows the 'white' property of AWGN, the analogy being with the optical part of the electromagnetic spectrum.

In the RF and microwave frequency range, if we take the upper frequency as \(f = 100 \, G H z \) and the component at approximately room temperature \(T = 290 \, K\), then \(h f \, \ll k T \) is valid and the first 2 terms of a Taylor series gives (2-2):

\[e^{\frac{hf}{kT}}-1 \approx \frac{hf}{kT} \]
(2-2) The approximation used to estimate the RMS AWGN voltage at realistic frequency and temperature for electronic parts.

Using (2-1) and (2-2), results in (2-3)[1]. This method is also known as the Raleigh-Jeans approximation.

\[V_n = \sqrt{4 k T B R}\]
(2-3) The practical equation for the RMS voltage of AWGN across the RF and microwave frequency range at typical temperatures.

This equation is sufficiently accurate to use for all communications equipment using the current technology. For very low temperatures and/or very high frequencies, using (2-1) directly may be slightly more accurate.

We can show that the mean noise power \(P_n\) is not a function of resistance by creating a Thevenin equivalent circuit for the AWGN source with a noise-free source resistance \(R\) connected to a normal (noisy) load of resistance \(R\) via a perfect bandpass filter (BPF). This will transfer the maximum possible power from the source to the load and is shown in Figure 2-2. Practical electronic parts would always be band limited so the BPF is necessary to define the applicable equivalent bandwidth of AWGN, \(B\) in (2-3), otherwise the noise power would theoretically be infinite [2] [4]. The BPF in has a hypothetical 'brick wall' frequency response: 100% transmission (zero insertion loss) in the transmission band \(f_1\) to \(f_2\) and zero transmission outside of this band.

Figure 2-2. The Thevenin constant voltage source for the AWGN source connected for maximum power transfer to a load resistance \(R\).

The mean AWGN noise power in the load resistor, \(P_n \) watts (\(W\)) is therefore given by (2-4).

\[ P_n = k \, T B \]
(2-4) The mean AWGN noise power as a function of noise bandwidth \(B\) and absolute temperature \(T\).

Gaussian Distribution of the Random Noise Voltages

AWGN is the result of large numbers of independent electron charges in random motion. The Gaussian property originates from the Central Limit Theorem [4] [5]. The voltage generated from each charge may be represented as a voltage vector whose amplitude and phase are also random. The resulting noise voltages will interact with each other according to their time and phase relationships. The instantaneous phase values will be uniformly distributed between 0 and 2\(\pi\) radians. The resultant noise voltages will have a Gaussian distribution with a mean value of zero.

(3-1) represents the probability density function (PDF) for a Gaussian distribution of an independent random variable \(x\) with a mean \(\mu\) and standard deviation \(\sigma\). For AWGN, \(x\) relates to the values of the noise voltages for a band-limited range of frequencies [2] [6] [10].

\[p(x) = \frac{1}{\sigma \sqrt{2 \pi}} exp{\left( - \frac{1}{2} \left( \frac{x - \mu}{\sigma} \right)^2 \right)} \]
Equation 3-1. The probability density function for a Gaussian (Normal) distribution of an independent variable \(x\) of mean value \(\mu\) and standard deviation \(\sigma\).

A special case of the PDF is the normalised form of (3-1) with a mean of zero (\(\mu = 0 \)) and a standard deviation of one (\( \sigma = 1 \)). This is shown in (3-2).

\[ p(x) = \frac{1}{\sqrt{2 \pi}} exp{\left( - \frac{x^2}{2} \right) } \]
(3-2) The normalized Gaussian PDF for a mean value of zero (\(\mu = 0\)) and standard deviation of one (\(\sigma = 1\)).

(3-2) is plotted in Figure 3-1. To consider the AWGN power, we start with the normalized Gaussian distribution function. In this case the mean is zero (\(\mu = 0 \)) and the standard deviation is 1 (\(\sigma = 1\)) for the normalized condition, so (3-1) becomes (3-2).

Figure 3-1.The Gaussian (normalised) PDF for the distribution of AWGN noise voltage amplitudes with a mean value \(\mu = 0\) and standard deviation \(\sigma = 1\). In this normalised case, the variance is also equal to 1 (\(\sigma^2 = 1\)).

As the variance is the square of the standard deviation, these values will both be numerically equal to one (\(\sigma^2 = \sigma = 1 \)) for the normalised case. For an absolute (un-normalised) example, we will also need to account for the units necessary for the variance and the standard deviation. The normalized condition means that the area under the curve is equal to one because the voltage range is nominally from \(- \infty \) to + \( \infty \), so every voltage must be included. If we apply this to AWGN, '\(x\)' becomes the spread of independent noise voltages from the electrons charges and also has a mean of zero. Furthermore, the band limited normalized AWGN (mean) noise power is equal to the variance of the distribution.

To relate the Gaussian PDF to an un-normalized version of AWGN, we may examine the following band-limited example: a noise bandwidth (\(B_N\)) of 100 \(M H z\), an absolute temperature (\(T\)) of 290 \(K\) and a load resistance (\(R\)) of 50 \(\Omega\). The mean AWGN power \(P_n\), using (2-4) is \(4 \times 10^{-13}\) \(W\). The mean square AWGN voltage, \(V_{M S}\) (3-3) and the RMS AWGN voltage, \(V_{R M S}\) (3-4) are equivalent to the variance (\(\sigma^2\)) and the standard deviation (\(\sigma\)) respectively.

\[V_{M S} = P_n R \]
(3-3) The mean square voltage \(V_{M S}\) of a band limited source of AWGN with mean power \(P_n\) and load resistance \(R\). This is equivalent to the variance \(\sigma^2\) of the associated Gaussian distribution.
\[V_{R M S} = \sqrt{P_n R} \]
(3-4)The root mean square (RMS) voltage \(V_{R M S}\) of a band limited source of AWGN with mean power \(P_n\) and load resistance \(R\). This is equivalent to the standard deviation \(\sigma\) of the associated Gaussian distribution.

So, for our example, using (3-3) for the variance and (3-4) for the standard deviation, we have \(\sigma^2 = 2 \times 10^{-11}\,\, V^2\) and \(\sigma = 4.4 \times 10^{-6}\,\,V \). We can then de-normalise the Gaussian independent variable \(x\) axis using \(\sigma = 4.4 \times 10^{-6}\,\,V\). This will also de-normalize the area under the PDF. The result of this is shown in Figure 3-2.

Figure 3-2 The Gaussian PDF for the example of bandwidth limited AWGN described in Section 2. The x axis has been de-normalised to absolute values of RMS AWGN voltage.

Looking again at the classic Gaussian PDF in Figure 3-2, also known as a normal distribution or bell curve because of its resemblance to the shape of a traditional bell, there are some interesting features. The probability of a noise voltage being between, say \(x_1\) and \(x_2\), \(p(x_1 \le x \le x_2) \), would be the area under the curve between \(x_1\) and \(x_2\). (3-5).

\[p (x_1 \le x \le x_2) = \int_{x_1}^{x_1} p(x) dx \]
(3-5) The probability of a value of \(x\) being between \(x_1\) and \(x_2 \).

Applying the Auto-correlation Function to AWGN Noise Samples

Further to the comments in Section 2, another way of understanding use of the term 'white' in AWGN is to apply the Auto Correlation Function (ACF) followed by a Fourier transform to convert the result from the time domain to a power against frequency spectrum [6] [7].

The individual charges which generate AWGN voltages are in large numbers, random and independent. Therefore, AWGN is the result of a random process. Then by applying the ACF to a sampled AWGN voltage against time waveform, the result is a delta function of the time difference (\( \tau \)) with a weighting of \(N_0 / 2 \) where \(N_0\) is the noise power density in watts/hertz, \(W / Hz\). (4-1).

\[ \begin{align} R_N (\tau) &= E \left[ N(t) \, N(t+\tau) \right] \\ &= \frac{N_0}{2} \delta(\tau) \\ \end{align} \]
(4-1) The result of the auto-correlation function applied to a AWGN waveform to give a delta function weighted by \(N_0 / 2 \)

The symbols used in (4-1) are:

In (4-1), the weighting of the delta function is divided by 2 to relate to the power on each side of a double sideband frequency spectrum, covering both positive and negative frequencies. For a single sided spectrum the weighting would be \(N_0\).

References

  1. Pozar, David M.; Microwave Engineering - Third Edition; John Wiley & Sons Inc.; pp. 487-493 (noise types, Rayleigh-Jeans approximation, thermal noise, noise temperature). ISBN  0-471-44878-8.
  2. Sklar, Bernard; Digital Communications, Fundamentals and Applications, Second Edition; Prentice Hall PTR, Upper Saddle River, New Jersey 07458; pp. 30-33 (noise types, statistics, thermal, Gaussian PDF, central limit theorem, white, auto-correlation function). ISBN 0130847887.
  3. Sklar (op. cit.) p258 (thermal noise to 1012 Hz); p282 (sky noise).
  4. Sklar (op. cit.) p116 (AWGN, white noise, variance) .
  5. Carlson, A. Bruce, Crilly, Paul B., Rutledge, Janet C.; Communication Systems, Fourth Edition; An Introduction to Signals and Noise in Electrical Communications; McGraw-Hill Higher Education, International Edition; pp. 372-378 (thermal noise, Gaussian, white, noise power density, autocorrelation function, independent charges, noise bandwidth); ISBN 0-07-112175-7.
  6. You Tube® Video, Central Limit Theorem, independent charges, Gaussian noise.. Professor Iain Collings
  7. You Tube® Video, What is White Gaussian Noise?, auto-corrrelation function Professor Iain Collings
  8. Carlson et. al. (op. cit.); p398 (AWGN, double-sided spectrum).
  9. Gonzalez, Guillermo; Microwave Transistor Amplifiers, Analysis and Design, Second Edition; Prentice Hall, Upper Saddle River, NJ 07458; p295 (thermal noise importance); p480 (thermal/random noise to 1000 GHz). ISBN 0-13-254335-4.
  10. Schwartz, Mischa; Information Transmission, Modulation and Noise, Third Edition; International Student Edition; McGraw-Hill Kogakusha, Ltd.; pp. 611-615 (Gaussian/Normal distribution, PDF); ISBN 0-07-055782-9.
  11. Taub, Schilling; Principles of Communications Systems, International Student Edition; McGraw-Hill International Hill Book Company; pp. 236-240 (Noise sources, white spectrum, noise power density); pp. 246-247 (noise power superposition/additive). ISBN 0-07-085790-3.