Real analysis/Series

From testwiki
Jump to navigation Jump to search

Definition

If (an) is a sequence, then we express the associated series as

n=1an.

We have the n-th partial sum

sn:=a1++an,

and hence an associated sequence of partial sums, {sn}. If the sequence of partial sums converges, then we define the infinite sum to be the limit:

n=1an=limnsn,

and say that the infinite series converges. Otherwise we shall say that it diverges, in which case no meaning for the symbol n=1an exists.

Examples

We'll start with some concrete examples, of which there are many:

  • Geometric Series: Any series of the form n=0arn is called a geometric series. As we'll see later, these converge for |r|<1 and are easy to sum. The general formula is n=1arn=a1r.
  • Telescoping Series: Any series of the form n=1anan1 is called a telescoping series. These are named after their "telescoping property", that the partial sums depend only on the first and last terms. As an exercise, prove that sn=ana0. Thus n=1(anan1)=limnsn=(limnan)a0.
  • Alternating Series: Any series of the form n=1(1)nan, where for all i, ai0 is called an alternating series.
  • p-series: Any series of the form n=11np is called a p-series. This kind of series is generally harder to evaluate than the two previously discussed. When p=2, for example, we get the amazing identity n=11n2=π26. That takes considerable effort to prove, so for the moment we will content ourselves with showing that n=11np diverges for p 1 and converges for p>1.
  • Decimal Expansions: Although these are intimately familiar to us, we have still not given a rigorous justification for their use. Such a justification can be given, as we will see later. The basic fact is that, up to a ambiguity involving repeated 9s, every real number a can be uniquely expressed in the form a=n=0an10n
  • Power Series: These should be familiar to anyone who has taken calculus. A power series is actually a function f that takes a real number x and returns a series, f(x)=n=0anxn. These, along with Fourier Series, will be examined in detail in a later chapter of the book, once we have covered sequences and series of functions.
  • Fourier Series: Like power series, these are functions that take a real number and return a series. However, the terms are trigonometric functions rather than powers of x. The general expression for a Fourier series is: f(x)=a0+n=1ancos(nx)+bnsin(nx).

Basic Facts

Here are some fairly straightforward facts about infinite series that require verifying. First, we need to make sure that series, like sequences, behave properly when we add them together, multiply by constants, and the like.

Theorem (Algebraic Operations)

If n=1an and n=1bn converge to a and b, respectively, then:

  • So does n=1can, and cn=1an=n=1can for any real c.
  • So does n=1(an+bn), and n=1an+n=1bn=n=1(an+bn)

Proof

  • Since n=1an converges to a, ϵ>0:N:nN:|k=1nana|<ϵ|c|.

Thus |c||k=1nana|<|c|ϵ|c||k=1ncanca|<ϵ

  • n=1(an+bn)=limnk=1n(an+bn)=limn(a1+b1+a2+b2++an+bn)=limn(a1+a2++an+b1+b2+bn)=limn(k=1n(an)+k=1n(bn))=limnk=1n(an)+limnk=1n(bn)=a+b

The following is merely a restatement of Cauchy's Criterion in the language of infinite series:

Theorem (Cauchy's Criterion for Series)

n=1an converges if and only if ϵ>0N:m>nN:|an+an+1++am1|<ϵ.

Proof

n=1an = limnsn, which converges if and only if ϵ>0N:m>nN:|snsm|=|an+an+1++am1|<ϵ.


Although the following theorem is stated in terms of convergence, it actually gives a useful criterion for divergence. Namely, if the terms of a series do not have limit 0, the series must diverge.

Theorem (Terms Have Limit 0)

For any converging series n=1an, limn(an)=0.

Proof

By the Cauchy Criterion for series ϵ>:N:m,nN:|an+am1|<ϵ. In particular, nN,|an|<ϵ. By definition, (an)0.

Positive and Alternating Series

We need to have ways of checking for convergence and divergence of various series. The following types of series arise quite often, and it is easy to verify when they converge and diverge:

Theorem (Positive Series Converge)

If an>0 for all n, then n=1an either converges or diverges to infinity.

Proof

Either the partial sums are bounded or unbounded. If they are bounded, sn+1=sn+an+1>sn, so they form a monotone sequence, which must converge by the monotone convergence theorem. If they are unbounded, then since all terms are positive, limnsn=. In other words, n=1an diverges to infinity.

Theorem (Alternating Series Test)

If (an) is a monotone sequence of positive real numbers such that limnan=0, then the alternating series n=0(1)n+1an converges.

Proof

Let sn=k=1n(1)k+1ak, and consider the sequence of intervals In=[s2n,s2n+1].

By assumption, the following inequalities hold:

s2n+2=s2n+a2n+1a2n+2>s2n,

s2n+2=s2n+1a2n<s2n+1,

s2n+3=s2n+1a2n+2+a2n+3<s2n+1,

and s2n+3=s2n+2+a2n+3>s2n+2

Thus (In) is a nested sequence of intervals, and n=1In must contain at least one point, x0.

Now, |s2nx0|<|s2ns2n+1|=|a2n+1|<|a2n| and |s2n+1x0|<|s2ns2n+1|=|a2n+1|.

Since (an)0, given ϵ>0:N:nN:|snx0|<|an+1|<ϵ. Thus n=0(1)n+1an=x0.

Comparison Test

To determine whether or not a series converges, sometimes it is necessary to compare it term-by-term with another series whose convergence or divergence we have previously ascertained. To do this rigorously, we need the following theorem:

Theorem (Comparison Test)

If n=1an and n=1bn are two series with anbn0, then:

  • If n=1an converges, then n=1bn converges.
  • If n=1bn diverges, then n=1an diverges.

Proof

  • n:an>bn>0, so the sequence of partial sums for an is monotone and k=1nbn<k=1nan<n=1an. Since the sequence of partial sums for bn is monotone and bounded above, n=1bn converges as well.
  • Since positive series either converge or diverge to infinity, this is just the contrapositive of the first statement.

Theorem (Limit Comparison Test)

If n=1an and n=1bn are two series with 0<limanbn<, then n=1an converges absolutely if and only if n=1bn converges.

Proof

  • Suppose the limit of the absolute value of their ratios converges to some number 0<r<. Then there exists an N such that if n>N, that anbnr<r2, so r2<|anbn<3r2. This means that r2bn<an<3r2bn. Hence, by the comparison test, if n=1bn converges, then n=1an also converges. Dividing by r2, one can also see by the comparison test that if n=1an converges, then n=1bn also converges.

Absolute Convergence

Frequently, we find that series with positive terms are easiest to work with. For one thing, these series always converge or diverge, as we have already seen. So, it is sometimes useful to compare a series to a corresponding positive-termed series, the series of absolute values:

We say a series n=1an is absolutely convergent if the series of the absolute values of its terms, n=1|an|, converges.

Theorem (Absolute Convergence)

If n=1an converges absolutely, then it converges.

Proof

If the series converges absolutely, then the sequence of partial sums sn=k=1n|an| converges.

Then, by the Cauchy Criterion, ϵ>0:N:n,mN:||an|++|am1||<ϵ.

By the triangle inequality |an++am1||an|++|am1|=||an|++|am1||<ϵ.

Again using the Cauchy Criterion, we see that n=1an converges.

Comparison with Geometric Series

A clever thing to do is to think of infinite series as geometric series with a variable ratio. If this ratio is "mostly" less than 1, the series converges, and if it is "mostly" greater than 1, the series diverges. This is expressed rigorously in the following two theorems. [Note: to avoid disrupting the format of the article, we are assuming without proof here that all geometric series with ratio less than 1 converge. For a proof of this, see the Examples with Proof section]

Theorem (Ratio Test)

If r=limn|xn||xn+1|<1, then n=1xn converges absolutely. If r > 1, then n=1xn diverges.

Proof

Let ϵ=1r>0.

Since limn|xn||xn+1|=r,N:nN:||xn||xn+1|r|<ϵ2.

So, nN:|xn|/|xn+1|<r+ϵ2.

Thus n=1|xn| = n=1N1|xn|+n=N|xn|

=n=1N1|xn|+n=N|xN||xN+1||xN||xN+2||xN+1||xn||xn1|

<n=1N1|xn|+n=N|xN|(r+ϵ2)nN, which converges since it is a constant plus a geometric series with ratio r+ϵ2<1.

By the comparison test, n=1|xn| converges.

Thus n=1xn converges absolutely.

The next theorem, the root test, is stronger than the ratio test in the sense that it works whenever the ratio test works (and returns the same number r), and it sometimes works even when the ratio test does not. This is because it uses the limit superior, which always converges for bounded sequences, and does not involve division. On the other hand, the ratio test uses regular limits, which do not always converge, and sometimes involves division by 0.

Theorem (Root Test)

Let R=limnsup(|an|1n). If R < 1, then the series n=1an converges absolutely. If R > 1, then it diverges.

Proof

If R<1, let R<ρ<1. Since limnsup(|an|1n)=R N:nN:|sup{|ak|1k|k>n}R|<ρR.

That is, nN:sup{|ak|1k|k>n}<ρ

Thus n=1|an|=n=1(|an|1n)n=n=1N1|an|+n=N(|an|1n)n<n=1N1|an|+n=N(sup{|ak|1k|k>n})n<n=1N1|an|+n=N(ρ)n, which converges since it is a constant plus a geometric series.

By the comparison test, n=1|an| converges as well. Thus n=1an converges absolutely.


If R > 1, then sup{|an|1n|k>n}>1. Thus there are infinitely many n such that |an|1n>1|an|>1.

Thus (an)↛0, which implies that n=1an diverges.

Sums of Products

We'll often be asked to consider series of the form n=1anbn. The following theorems give criteria for convergence of these series.

Theorem (Dirichlet's Test)

If the partial sums of n=1xn are bounded, and (yn) is a decreasing sequence with limnyn=0, then n=1xnyn converges. [Note: n=1xn need not converge]

Proof

Let sn=m=1nxm be the nth partial sum, so that there exists B>0 such that |sn|B.

We can write

n=1Nxnyn=x1y1+n=2N(snsn1)yn=x1y1+n=2Nsnynn=2Nsn1yn.

Changing the index of summation in the last sum, this becomes

n=1Nxnyn=x1y1+n=2Nsnynn=1N1snyn+1=x1y1+n=2N1sn(ynyn+1)+sNyN.

The sum on the right-hand side is bounded absolutely by the telescoping sum

n=2N1|sn(ynyn+1)|Bn=2N1(ynyn+1)=B(y2yN)By2;

here we have used the fact that (yn) is positive and decreasing. It follows that

n=2sn(ynyn+1) is absolutely convergent, hence convergent.

Notice that limNsNyN=0 since sN is bounded and (yn) tends to 0 as n tends to infinity. Therefore we can take limits as N goes to infinity:

n=1xnyn=x1y1+n=2sn(ynyn+1)+limNsNyN=x1y1+n=2sn(ynyn+1),

which proves that the left-hand side is convergent.

Abel's Test can be regarded as a special case of Dirichlet's Test, once some modifications have been made:

Theorem (Abel's Test)

If n=1xn converges and (yn) is a positive, decreasing sequence, then n=1xnyn converges.

Proof

Because (yn) is a bounded, monotone sequence, it converges to some limit y.

Let zn=yny. Then n=1xn and (zn) satisfy the conditions for Dirichlet's test.

n=1kxnyn=yn=1kxn+n=1kxnzn. By Dirichlet's test, n=1kxnzn converges as k.

Since both sums on the right converge, n=1xnyn converges as well.

Examples with Proof

Now we'll do the computations promised in the Examples, plus a few extra.

Theorem (Geometric Series)

If |r|<1, the geometric series n=1arn=a1r. If |r|1, the series diverges.

Proof

In this case, it is best to explicitly compute the partial sums and take the limit. Without loss of generality, we'll consider the case a=1. Then we can apply the theorem on algebraic operations to obtain the general result.

Note that sn(1r)=(1+r+r2+...+rn)(1r)=(1+r+r2+...+rn)(r+r2+...+rn+1)=1rn+1

Thus sn=1rn1r. Taking the limit (and remembering some basic facts about sequences):

If |r|<1, n=1rn=limnsn=limn1rn1r=11r.

If |r|1, the sequence of partial sums diverges to infinity, and thus by definition the series diverges.

This proof seems to work except for the fact that this series will converge to a1r

Theorem(p-series)

The p-series n=11np converges for p>1 and diverges for 0<p1. [Note: We have technically only defined this series for p rational. However, the theorem is still valid when p is irrational, for the same reasons]

Proof

First we'll consider the special cases p=1,p=2, and then obtain the general result from these.

  • If p = 1, let xn be the greatest power of 2 less than 1n. That is, (xn)=(12,14,14,18,18,18,18,).

Grouping like terms together, i=1xn=i=0(j=2i2i+11xj)=i=0(j=2i2i+1112i+1)=i=112, which diverges.

By definition, xn<1n, so by the comparison test n=11n diverges.


  • If p = 2, let xn=1n(n1)=1n11n if n>1 and 1 if n=1.

Using the theorem on telescoping series, n=1xn=1+n=2(1n11n)=1+1limn(1/n)=2

By definition, xn>1nn=1n2, so by the comparison test n=11n2 converges as well.


  • If 0<p<1, then 1np>1n. By the comparison test n=11np diverges.

Theorem(Decimal Expansions)

Given any real number x, 0<x<1there is a unique sequence (xn):n=0xn10n=x, 0xn<10 and N:nN:xn=9

Proof

Inductively, assume that there exist x0,x1,,xk such that n=0kxn10nx<n=0kxn10n+110k.

Rearranging, we see that 0xn=0kxn10n<110k, or 0(xn=0kxn10n)10k+1<10.

Let xk+1 by the greatest integer such that xk+1(xn=0kxn10n)10k+1.

Then xk+110k+1xn=0kxn10n<xk+1+110k+1(otherwise, xk+1 would not be the greatest).

Adding n=0kxn10n, we see that n=0k+1xn10nx<n=0k+1xn10n+110k+1.

Given ϵ>0 pick N such that ϵ>110N.

Thus |n=0kxn10n1|<110k<ϵ for all k>N. That is, x=n=0xn10n.

TODO: eliminate 9s, uniqueness.


Topics to come: Rearrangement of terms, Alternating Series Test, Sums of products(i.e. Abel's Test and Dirichlet's Test), Multiple Summations, Infinite Products, decimal expansions, zeta function