Exponential Function Product Rule

A first definition of exponential and logarithmic functions

Motivation from compound interest

Increase the number of times that the interest is compounded each year (nn), so as to increase the final amount of money (AA)

A=P(1+rn)nt.A = P \left(1 + \frac{r}{n}\right)^{nt}.

tt and rr are the number of years and the interest rate per annum.

As nn becomes large, we can approximate the amount by

A=Pert.A = P e^{rt}.

The value of AA in the above formula is the amount compounded continuously.

Questions

  1. What is (the definition of) the constant ee?
  2. In practice, rr is a rational number. (i.e. rQr \in \Q) What if rr is irrational? Then we would run into irrational indices.

Goal

To store the technical details somewhere on the web.

  1. To give a logical introduction to the concept of two elementary functions: exponential function and logarithms.
  2. To fill the gap between rational and irrational indices.

Raison d’être

In exam-oriented secondary education, students are required to make calculations using their scientific calculators. It would be convenient, for school teachers, to infer from the law of indices on Q\Q to their counterpart on R\R, and to ask students to write the calculator’s output (say, for 2π2^\pi). Math teachers aren’t math major (like me), so some of them might not even know how these two elementary functions are defined and developed. Their job is to pass the classic formulae to students. As a result, students resort to rote or muscle memory. The former is prone to mistakes, especially under exam stress. This leads to low achievement.

This article aims to fill up the gap for interested students. In the first few big proofs, I only use integer exponents, so that knowing the basic definition of indices would suffice.

Facts needed

  1. Product rule of limits: lim(AB)=(limA)(limB)\lim (A \cdot B) = \left(\lim A \right) \left(\lim B \right), provided both limits on the RHS exist.

  2. Binomial Theorem:

    (a+b)n=k=0n(nk)ankbk.(a+b)^n = \sum_{k = 0}^n \binom{n}{k} a^{n-k} b^{k}.
  3. Geometric sum formula (finite version):

    i=0nari=a(1rn+1)1r,  r1.\sum_{i = 0}^n ar^i = \frac{a(1-r^{n+1})}{1-r}, \; r \ne 1.
  4. Limit exists implies boundedness: if limn+an\lim_{n\to+\infty} a_n exists, then there exists a constant M>0M>0 such that for all nn, anM\lvert a_n \rvert \le M.

  5. Monotone Convergence Theorem and monotonicity of limits:

    n:anbn    limnanlimnbn.\forall n: a_n \le b_n \implies \lim_n a_n \le \lim_n b_n.

Recall the definition of exponential function

For any real number ss, the limit limn+(1+s/n)n\lim_{n\to+\infty} (1+s/n)^n exists, and it’s denoted by ese^s, or exp(s)\exp(s).

Proof:

We’ll show that the sequence with the general term (1+s/n)n(1 + s/n)^n is bounded, then strictly increasing for s>0s > 0, so that we can apply the Monotone Convergence Theorem to establish the existence of the desired limit for s>0s > 0. After that, we’ll use the quotient rule for limits to finish.

Boundedness

The main idea is that factorial function kk!k \mapsto k! is much greater than the exponential function (with a fixed base mm) kmkk \mapsto m^k.

  • Our definition of exponential function is a limit of a binomial,
  • which can be expanded into a sum involving binomial coefficients,
  • which is a fraction with k!k! as the denominator.
  • by bounding 1/k!1/k! above by a term from a well-chosen exponential function (with a base strictly smaller than 11), we can apply the geometric sum formula (for finitely many terms, then discard the negative term in the numerator) to set up an upper bound independent of nn.
  (1+sn)n=k=0n(nk)(sn)kk=0n(nk)(sn)k=1+s+k=2nskk!n(n1)(n+1k)nk<1+s+k=2n(sk2k1)(1)=1+s+2(s2)21(s/2)n11s/2 \begin{align} &\;\left(1+\frac{s}{n}\right)^n \\ =& \sum_{k=0}^n \binom{n}{k} \left(\frac{s}{n}\right)^k \\ \le& \sum_{k=0}^n \binom{n}{k} \left(\frac{\lvert s \rvert}{n}\right)^k \\ =& 1 + \lvert s \rvert + \sum_{k=2}^n \frac{\lvert s \rvert^k}{k!} \, \frac{n (n-1) \cdots (n+1-k)}{n^k} \\ <& 1+\lvert s\rvert+\sum_{k=2}^n \left(\frac{\lvert s\rvert^k}{2^{k-1}}\right) (1) \\ =& 1 + \lvert s \rvert + 2\left(\frac{\lvert s \rvert}{2}\right)^2 \frac{1-(\lvert s \rvert/2)^{n-1}}{1-\lvert s \rvert/2} \end{align}

The above argument only works for s<2\lvert s \rvert < 2. For larger s\lvert s \rvert, we need to change ‘22’ to a larger integer MM, so that the geometric sum formula (for finitely many terms) can be applied. We choose this MNM \in \N so that 2s<M2 \le \lvert s \rvert < M. It’s clear that M3M \ge 3.

For the case s2\lvert s \rvert \ge 2, in the sum (4), we discard the fraction on the right (by bounding it above by 11), and we divide the sum into two parts

1+s+k=2M1skk!+k=Mnskk!. 1 + \lvert s \rvert + \sum_{k=2}^{M-1} \frac{\lvert s \rvert^k}{k!} + \sum_{k=M}^n \frac{\lvert s \rvert^k}{k!}.

We’ll only focus on the last term (the “tail”).

It took me a while to work out the tedious details.

k!=k(k1)M(M1)21MkM+12M2=12(2M)M1Mkskk!2(M2)M1(sM)kk=Mnskk!2(M2)M1(sM)M1(s/M)nM+11(s/M)<4Ms(s2)M \begin{align} k! =& k (k - 1) \cdots M (M - 1) \cdots 2 \cdot 1 \\ \ge& M^{k - M + 1} \cdot 2^{M - 2} = \frac12 \left(\frac2M\right)^{M - 1} M^k \\ \frac{\lvert s \rvert^k}{k!} \le& 2 \left(\frac{M}{2}\right)^{M - 1} \left(\frac{\lvert s \rvert}{M}\right)^k \\ \sum_{k=M}^n \frac{\lvert s \rvert^k}{k!} \le& 2 \left(\frac{M}{2}\right)^{M - 1} \left(\frac{\lvert s \rvert}{M}\right)^M \frac{1-(\lvert s \rvert/M)^{n - M + 1}}{1-(\lvert s \rvert/M)} \\ <& \frac{4}{M - \lvert s \rvert} \left(\frac{\lvert s \rvert}{2}\right)^M \end{align}

Strictly increasing

Suppose that s>0s > 0.

  (1+sn+1)n+1=1+s+k=2n+1skk!n+1n+1nn+1n+2kn+1>1+s+k=2nskk!nnn1nn+1kn=(1+sn)n \begin{align} & \; \left(1 + \frac{s}{n + 1}\right)^{n + 1} \\ =& 1 + s + \sum_{k=2}^{n+1} \frac{s^k}{k!} \frac{n+1}{n+1} \, \frac{n}{n+1} \cdots \frac{n+2-k}{n+1} \\ >& 1 + s + \sum_{k=2}^n \frac{s^k}{k!} \frac{n}{n} \, \frac{n-1}{n} \cdots \frac{n+1-k}{n} \\ =& \left(1 + \frac{s}{n} \right)^{n} \end{align}

Negative exponents

For any s>0s > 0, we’re going to show that

limn+(1+sn)n(1+sn)n=1. \lim_{n\to+\infty} \left(1+\frac{-s}{n}\right)^n \left(1+\frac{s}{n}\right)^n=1.
  (1+sn)n(1+sn)n=(1s2n2)n=1+k=1n(nk)(1)k(sn)2k \begin{align} &\; \left(1+\frac{-s}{n}\right)^n \left(1+\frac{s}{n}\right)^n \\ =& \left(1-\frac{s^2}{n^2}\right)^n \\ =& 1 + \sum_{k=1}^n \binom{n}{k} (-1)^k \left(\frac{s}{n}\right)^{2k} \end{align}

We claim that the last term tends to zero as n+n \to +\infty.

  k=1n(nk)(1)k(sn)2kk=1n(nk)(sn)2k=k=1n1k!n(n+1k)nk(s2n)k<s2n1(s2/n)n1s2/n<s2ns2n+0 \begin{align} &\; \left\lvert \sum_{k=1}^n \binom{n}{k} (-1)^k \left(\frac{s}{n}\right)^{2k} \right\rvert \\ \le& \sum_{k=1}^n \binom{n}{k} \left(\frac{s}{n}\right)^{2k} \\ =& \sum_{k=1}^n \frac{1}{k!} \, \frac{n \cdots (n+1-k)}{n^k} \left(\frac{s^2}{n}\right)^k \\ <& \frac{s^2}{n} \, \frac{1-(s^2/n)^n}{1-s^2/n} \\ <& \frac{s^2}{n - s^2} \xrightarrow{n \to +\infty} 0 \end{align}

This shows the desired limit in the beginning of this subsection. Apply this together with the case that s>0s>0 (that we’ve just proved) and the quotient rule for limits to see that

limn+(1sn)n=1es.\lim_{n\to+\infty} \left(1-\frac{s}{n}\right)^n = \frac{1}{e^s}.

Exercise: try to find a gap in the above argument.

From the above proof, we have the identity eses=1e^s \cdot e^{-s} = 1.

Remark: Here the condition that s>0s > 0 is needed. You may experiment with large negative numbers for ss (say s=100s = -100) and a short array of large consecutive values of nn (say n{61,62,,80}n \in \lbrace 61, 62, \dots, 80 \rbrace) to see the oscillation of the sequence ((1+s/n)n)n\left((1+s/n)^n\right)_n.

Main result

The well-known basic identity es+t=esete^{s+t} = e^s \cdot e^t.

Derivation

  eset=limn+(1+sn)nlimn+(1+tn)n=limn+(1+s+tn+stn2)n=limn+k=0n(nk)(1+s+tn)nk(stn2)k \begin{align} & \; e^s \cdot e^t \\ =& \lim_{n\to+\infty} \left(1+\frac{s}{n}\right)^n \cdot \lim_{n\to+\infty} \left(1+\frac{t}{n}\right)^n \\ =& \lim_{n\to+\infty} \left(1+\frac{s+t}{n}+\frac{st}{n^2}\right)^n \\ =& \lim_{n\to+\infty} \sum_{k=0}^n \binom{n}{k} \left(1+\frac{s+t}{n}\right)^{n-k} \left(\frac{st}{n^2}\right)^k \end{align}

We’re going to see that only the first term in the above sum is relevant.

Claim:

limn+k=1n(nk)(1+s+tn)nk(stn2)k=0 \lim_{n\to+\infty} \sum_{k=1}^n \binom{n}{k} \left(1+\frac{s+t}{n}\right)^{n-k} \left(\frac{st}{n^2}\right)^k=0

Proof:

The trick is to find an upper bound which is a term of a geometric sequence.

  (nk)(1+s+tn)nk(stn2)k=1k!(nnn1nn+1kn)(1+s+tn)n(stn+s+t)k<(1)(111)(M)(stn+s+t)k \begin{align} &\;\binom{n}{k}\left(1+\frac{s+t}{n}\right)^{n-k}\left(\frac{st}{n^2}\right)^k\\ =& \frac{1}{k!} \left(\frac{n}{n}\,\frac{n-1}{n}\cdots\frac{n+1-k}{n}\right) \left(1+\frac{s+t}{n}\right)^n \left(\frac{st}{n+s+t}\right)^k \\ <& (1)(1 \cdot 1 \cdots 1)(M) \left(\frac{st}{n+s+t}\right)^k \end{align}

We used the fact (that allows the definition of the exponential function) that limn+(1+(s+t)/n)n\lim_{n\to+\infty} (1+(s+t)/n)^n exists.

From the above inequality, we have

  k=1n(nk)(1+s+tn)nk(stn2)k<k=1nM(stn+s+t)k=M(stn+s+t)1(stn+s+t)n1stn+s+t<M(stn+s+t)11stn+s+t=Mstn+s+tstn+0 \begin{align} &\;\sum_{k=1}^n \binom{n}{k} \left(1+\frac{s+t}{n}\right)^{n-k} \left(\frac{st}{n^2}\right)^k \\ <& \sum_{k=1}^n M \left(\frac{st}{n+s+t}\right)^k \\ =& M \left(\frac{st}{n+s+t}\right) \frac{1 - \left(\frac{st}{n+s+t}\right)^n}{1 - \frac{st}{n+s+t}} \\ <& M \left(\frac{st}{n+s+t}\right) \frac{1}{1 - \frac{st}{n+s+t}} \\ =& \frac{Mst}{n+s+t-st} \xrightarrow{n\to+\infty} 0 \end{align}

Apply this limit to the equation before the claim to see that only the first term of the sum has to be kept.

eset=limn+(1+sn)nlimn+(1+tn)n=limn+(1+s+tn)n=es+t \begin{align} e^s \cdot e^t =& \lim_{n\to+\infty} \left(1+\frac{s}{n}\right)^n \lim_{n\to+\infty} \left(1+\frac{t}{n}\right)^n \\ =& \lim_{n\to+\infty} \left(1+\frac{s+t}{n}\right)^n = e^{s+t} \end{align}

Definition of log function

To see that the exponential function exp:RR+\exp:\R\to\R_{+} is strictly increasing, we apply the above multiplicative formula. Suppose that s<ts < t, and we want to compare ese^s with ete^t. We have et=esetse^t = e^s \cdot e^{t-s}. Once we can show that ets>1e^{t-s}>1, then we’re done. Note that the exponent ts>0t-s>0, so from the first four lines in the subsection Boundedness, we see that ets1+(ts)>1e^{t-s} \ge 1+(t-s)>1 (only the first two terms in the fourth line are taken).

Thus, the exponential function is bijective, and it has an inverse function, which is called the natural log and is denoted by ln\ln. It’s obvious that es=a    s=ln(a)e^s = a \iff s = \ln(a). Two useful forms of this “    \iff” statement:

  1. ln(es)(=ln(a))=s\ln(e^s) (= \ln(a)) = s (i.e. eslnse^s \overset{\ln}{\mapsto} s)
  2. eln(a)(=es)=ae^{\ln(a)} (= e^s) = a (i.e. ln(a)expa\ln(a) \overset{\exp}{\mapsto} a).

Corollary

ln(ab)=ln(a)+ln(b)\ln(ab) = \ln(a) + \ln(b)

Proof: write a=esa = e^s and b=etb = e^t. Then ab=es+tab = e^{s + t}. Take log on both sides to see that ln(ab)=s+t=ln(a)+ln(b)\ln(ab) = s + t = \ln(a) + \ln(b).

General definition of exponents

Let a>0a > 0 and sRs \in \R. We define as:=esln(a)a^s := e^{s\ln(a)}. It’s read as “aa to the power ss”.

Rediscovery of law of indices

Let a>0a > 0, and s,tRs,t \in \R.

Zero power: a0=1a^0 = 1

a0=e0ln(a)=e0=1a^0 = e^{0 \ln (a)} = e^0 = 1

The last equality is from our definition of the exponential function with s=0s=0, so that the expression on the right of the lim\lim symbol becomes the constant 11.

Exercise: What is a1a^1?

Negative power: as=1/asa^{-s} = 1 / a^s

Recall: at the end of the subsection Negative Exponents, we have the identity etet=1e^t \cdot e^{-t} = 1, so et=(et)1=1/ete^{-t} = \left(e^t\right)^{-1} = 1 / e^t for all tRt \in \R. Put t=sln(a)t = s\ln(a), which is the exponent on the RHS of as=esln(a)a^s = e^{s\ln(a)} to see that as=1/esln(a)=1/asa^{-s} = 1 / e^{s\ln(a)} = 1 / a^s.

Multiplication: asat=as+ta^s \cdot a^t = a^{s + t}.

asat=esln(a)etln(a)=esln(a)+tln(a)=e(s+t)ln(a)a^s \cdot a^t = e^{s\ln(a)} \cdot e^{t\ln(a)} = e^{s \ln (a) + t \ln(a)} = e^{(s+t) \ln (a)}

Division: as/at=asta^s / a^t = a^{s - t}

as/at=asat=as+(t)=asta^s / a^t = a^{s} \cdot a^{-t} = a^{s + (-t)} = a^{s - t}

Power of a power: (as)t=ast(a^s)^t = a^{st}

(as)t=(esln(a))t=etln(esln(a))=et(sln(a))=estln(a)=ast(a^s)^t = (e^{s\ln(a)})^t = e^{t\ln\left(e^{s\ln(a)}\right)} = e^{t(s\ln(a))} = e^{st\ln(a)} = a^{st}

Multiplication with same index: (ab)s=asbs(ab)^s = a^s \cdot b^s

(ab)s=esln(ab)=es[ln(a)+ln(b)]=esln(a)esln(b)=asbs \begin{align} (ab)^s =& e^{s\ln(ab)} \\ =& e^{s[\ln(a) + \ln(b)]} \\ =& e^{s\ln(a)} \cdot e^{s\ln(b)} \\ =& a^s \cdot b^s \end{align}

Rediscovery of law of logarithms

Let a,b>0a,b > 0 and sRs \in \R such that as=ba^s = b. A textbook defines logab\log_a b to be ss. Using our definition of exponents, we can easily retreive the change of base formula

esln(a)=as=bsln(a)=ln(b)s=ln(b)ln(a). \begin{align} e^{s \ln(a)} = a^s &= b \\ s \ln(a) &= \ln(b) \\ s &= \frac{\ln(b)}{\ln(a)}. \end{align}

Here’re two conventions.

base aa loga\log_a written as name
ee ln\ln natural log
1010 log\log common log

I’ll left the derivation of remaining laws as an exercise, so that you can practice your understanding of the above definitions and formulae.

limits 

1 comment

Vincent Tam's gravatar

Vincent Tam

Try new service. Here’s a proof for Minikowski’s inequality. Suppose that a,b>0a,b>0. If a=ba = b, we have the equality, so WLOG, we assume that a>ba > b.

(an(bn=abk=0n1(ank(bnn1k=(ab)1/n(ab)(n1)/nk=0n1(ank(bnn1k\begin{align*} \sqrt[n]{\mathstrut a}-\sqrt[n]{\mathstrut b} &= \frac{a-b}{\sum_{k=0}^{n-1} \sqrt[n]{\mathstrut a}^k \sqrt[n]{\mathstrut b}^{n-1-k}} \\ &= \frac{(a-b)^{1/n}(a-b)^{(n-1)/n}}{\sum_{k=0}^{n-1} \sqrt[n]{\mathstrut a}^k \sqrt[n]{\mathstrut b}^{n-1-k}} \end{align*}

We want to show that (ab)(n1)/nk=0n1(ank(bnn1k(a-b)^{(n-1)/n} \le \sum_{k=0}^{n-1} \sqrt[n]{\mathstrut a}^k \sqrt[n]{\mathstrut b}^{n-1-k}. We make a change of variables:

  • abha - b \leftarrow h (replace aba-b with a symbol hh)
  • bab \leftarrow a (replace bb with a symbol aa)
  • then aa would be replaced by a+ha + h.

The above inequality becomes hn1(k=0n1(a+hnk(ann1k)nh^{n-1} \le \left(\sum_{k=0}^{n-1} \sqrt[n]{\mathstrut a+h}^k \sqrt[n]{\mathstrut a}^{n-1-k}\right)^n. On RHS, consider the term with k=n1k = n - 1:

[(a+h)(n1)/n+other n1 terms]n>[(a+h)(n1)/n]n=(a+h)n1>hn1.\begin{aligned} \left[(a+h)^{(n-1)/n} + \textrm{other } n - 1 \textrm{ terms}\right]^n &> \left[(a+h)^{(n-1)/n}\right]^n \\ &= (a+h)^{n-1} > h^{n-1}. \end{aligned}

Here we use the strict monotonicity of the function xxnx \mapsto x^n on [0,)[0,\infty). We have strict inequalities since we assume that a>ba > b, so h>0h > 0. Hence,

(an(bn<(abn(an<(bn+(abn(a+bn<(an+(bn\begin{align*} \sqrt[n]{\mathstrut a}-\sqrt[n]{\mathstrut b} &< \sqrt[n]{\mathstrut a - b} \\ \sqrt[n]{\mathstrut a} &< \sqrt[n]{\mathstrut b} + \sqrt[n]{\mathstrut a - b} \\ \sqrt[n]{\mathstrut a + b} &< \sqrt[n]{\mathstrut a} + \sqrt[n]{\mathstrut b} \end{align*}

Your email address will not be published. Required fields are marked *.