Real analysis/Series
Definition
If is a sequence, then we express the associated series as
- .
We have the n-th partial sum
- ,
and hence an associated sequence of partial sums, . If the sequence of partial sums converges, then we define the infinite sum to be the limit:
- ,
and say that the infinite series converges. Otherwise we shall say that it diverges, in which case no meaning for the symbol exists.
Examples
We'll start with some concrete examples, of which there are many:
- Geometric Series: Any series of the form is called a geometric series. As we'll see later, these converge for and are easy to sum. The general formula is .
- Telescoping Series: Any series of the form is called a telescoping series. These are named after their "telescoping property", that the partial sums depend only on the first and last terms. As an exercise, prove that . Thus .
- Alternating Series: Any series of the form , where for all i, is called an alternating series.
- p-series: Any series of the form is called a p-series. This kind of series is generally harder to evaluate than the two previously discussed. When p=2, for example, we get the amazing identity . That takes considerable effort to prove, so for the moment we will content ourselves with showing that diverges for p 1 and converges for p>1.
- Decimal Expansions: Although these are intimately familiar to us, we have still not given a rigorous justification for their use. Such a justification can be given, as we will see later. The basic fact is that, up to a ambiguity involving repeated 9s, every real number can be uniquely expressed in the form
- Power Series: These should be familiar to anyone who has taken calculus. A power series is actually a function that takes a real number and returns a series, . These, along with Fourier Series, will be examined in detail in a later chapter of the book, once we have covered sequences and series of functions.
- Fourier Series: Like power series, these are functions that take a real number and return a series. However, the terms are trigonometric functions rather than powers of x. The general expression for a Fourier series is: .
Basic Facts
Here are some fairly straightforward facts about infinite series that require verifying. First, we need to make sure that series, like sequences, behave properly when we add them together, multiply by constants, and the like.
Theorem (Algebraic Operations)
If and converge to a and b, respectively, then:
- So does , and for any real c.
- So does , and
Proof
- Since converges to a, .
Thus
The following is merely a restatement of Cauchy's Criterion in the language of infinite series:
Theorem (Cauchy's Criterion for Series)
converges if and only if .
Proof
= , which converges if and only if .
Although the following theorem is stated in terms of convergence, it actually gives a useful criterion for divergence. Namely, if the terms of a series do not have limit 0, the series must diverge.
Theorem (Terms Have Limit 0)
For any converging series ,
Proof
By the Cauchy Criterion for series . In particular, . By definition, .
Positive and Alternating Series
We need to have ways of checking for convergence and divergence of various series. The following types of series arise quite often, and it is easy to verify when they converge and diverge:
Theorem (Positive Series Converge)
If for all n, then either converges or diverges to infinity.
Proof
Either the partial sums are bounded or unbounded. If they are bounded, , so they form a monotone sequence, which must converge by the monotone convergence theorem. If they are unbounded, then since all terms are positive, . In other words, diverges to infinity.
Theorem (Alternating Series Test)
If is a monotone sequence of positive real numbers such that , then the alternating series converges.
Proof
Let , and consider the sequence of intervals .
By assumption, the following inequalities hold:
,
,
,
and
Thus is a nested sequence of intervals, and must contain at least one point, .
Now, and .
Since , given . Thus .
Comparison Test
To determine whether or not a series converges, sometimes it is necessary to compare it term-by-term with another series whose convergence or divergence we have previously ascertained. To do this rigorously, we need the following theorem:
Theorem (Comparison Test)
If and are two series with , then:
- If converges, then converges.
- If diverges, then diverges.
Proof
- , so the sequence of partial sums for is monotone and . Since the sequence of partial sums for is monotone and bounded above, converges as well.
- Since positive series either converge or diverge to infinity, this is just the contrapositive of the first statement.
Theorem (Limit Comparison Test)
If and are two series with , then converges absolutely if and only if converges.
Proof
- Suppose the limit of the absolute value of their ratios converges to some number 0<r<. Then there exists an N such that if n>N, that , so . This means that . Hence, by the comparison test, if converges, then also converges. Dividing by , one can also see by the comparison test that if converges, then also converges.
Absolute Convergence
Frequently, we find that series with positive terms are easiest to work with. For one thing, these series always converge or diverge, as we have already seen. So, it is sometimes useful to compare a series to a corresponding positive-termed series, the series of absolute values:
We say a series is absolutely convergent if the series of the absolute values of its terms, , converges.
Theorem (Absolute Convergence)
If converges absolutely, then it converges.
Proof
If the series converges absolutely, then the sequence of partial sums converges.
Then, by the Cauchy Criterion, .
By the triangle inequality .
Again using the Cauchy Criterion, we see that converges.
Comparison with Geometric Series
A clever thing to do is to think of infinite series as geometric series with a variable ratio. If this ratio is "mostly" less than 1, the series converges, and if it is "mostly" greater than 1, the series diverges. This is expressed rigorously in the following two theorems. [Note: to avoid disrupting the format of the article, we are assuming without proof here that all geometric series with ratio less than 1 converge. For a proof of this, see the Examples with Proof section]
Theorem (Ratio Test)
If , then converges absolutely. If r > 1, then diverges.
Proof
Let .
Since ,.
So, .
Thus =
, which converges since it is a constant plus a geometric series with ratio .
By the comparison test, converges.
Thus converges absolutely.
The next theorem, the root test, is stronger than the ratio test in the sense that it works whenever the ratio test works (and returns the same number r), and it sometimes works even when the ratio test does not. This is because it uses the limit superior, which always converges for bounded sequences, and does not involve division. On the other hand, the ratio test uses regular limits, which do not always converge, and sometimes involves division by 0.
Theorem (Root Test)
Let . If R < 1, then the series converges absolutely. If R > 1, then it diverges.
Proof
If R<1, let . Since .
That is,
Thus , which converges since it is a constant plus a geometric series.
By the comparison test, converges as well. Thus converges absolutely.
If R > 1, then . Thus there are infinitely many n such that .
Thus , which implies that diverges.
Sums of Products
We'll often be asked to consider series of the form . The following theorems give criteria for convergence of these series.
Theorem (Dirichlet's Test)
If the partial sums of are bounded, and is a decreasing sequence with , then converges. [Note: need not converge]
Proof
Let be the th partial sum, so that there exists such that .
We can write
.
Changing the index of summation in the last sum, this becomes
.
The sum on the right-hand side is bounded absolutely by the telescoping sum
;
here we have used the fact that is positive and decreasing. It follows that
is absolutely convergent, hence convergent.
Notice that since is bounded and tends to 0 as tends to infinity. Therefore we can take limits as goes to infinity:
,
which proves that the left-hand side is convergent.
Abel's Test can be regarded as a special case of Dirichlet's Test, once some modifications have been made:
Theorem (Abel's Test)
If converges and is a positive, decreasing sequence, then converges.
Proof
Because is a bounded, monotone sequence, it converges to some limit y.
Let . Then and satisfy the conditions for Dirichlet's test.
. By Dirichlet's test, converges as .
Since both sums on the right converge, converges as well.
Examples with Proof
Now we'll do the computations promised in the Examples, plus a few extra.
Theorem (Geometric Series)
If , the geometric series . If , the series diverges.
Proof
In this case, it is best to explicitly compute the partial sums and take the limit. Without loss of generality, we'll consider the case . Then we can apply the theorem on algebraic operations to obtain the general result.
Note that
Thus . Taking the limit (and remembering some basic facts about sequences):
If , .
If , the sequence of partial sums diverges to infinity, and thus by definition the series diverges.
This proof seems to work except for the fact that this series will converge to
Theorem(p-series)
The p-series converges for and diverges for . [Note: We have technically only defined this series for p rational. However, the theorem is still valid when p is irrational, for the same reasons]
Proof
First we'll consider the special cases , and then obtain the general result from these.
- If p = 1, let be the greatest power of 2 less than . That is, .
Grouping like terms together, , which diverges.
By definition, , so by the comparison test diverges.
- If p = 2, let if n>1 and 1 if n=1.
Using the theorem on telescoping series,
By definition, , so by the comparison test converges as well.
- If 0<p<1, then . By the comparison test diverges.
Theorem(Decimal Expansions)
Given any real number x, there is a unique sequence , and
Proof
Inductively, assume that there exist such that .
Rearranging, we see that , or .
Let by the greatest integer such that .
Then (otherwise, would not be the greatest).
Adding , we see that .
Given pick N such that .
Thus for all . That is, .
TODO: eliminate 9s, uniqueness.
Topics to come: Rearrangement of terms, Alternating Series Test, Sums of products(i.e. Abel's Test and Dirichlet's Test), Multiple Summations, Infinite Products, decimal expansions, zeta function