Sigma notation
Sigma notation is often used to write complicated sums in a concise and compact way. One of the most common forms is
|
|
(1) |
The symbol (capital sigma) means sum and the expression (1) is equivalent to the sum
|
|
The starting and stopping values are written below and above the symbol respectively, and below we also specify which will be our running variable (or summation index) that will be changing values. So in the former expression, is the running variable, taking values starting at and stopping at .
Usually it’s assumed that in (1) since otherwise there would be no summands. However it is also customary to take the value of the sum as zero when .
For instance, if we wanted to represent the sum of all integers between and we would write:
|
|
here we are taking as summation index, and we are adding where runs over all the integers starting at and ending at .
Now suppose we wanted to represent the sum . The straightforward way to convert it to sigma notation is
|
|
However, it must be noted that such representation is not unique. For instance, here is another way to express the same summation:
|
|
If we wanted to sum all positive even numbers not greater than we would write
|
|
since if we substitute into we get .
Now, if we wanted to write all odd numbers not greater than we would write
|
|
It must be noted that, although the running variable usually takes integer values, the summation function needs not, and it can lie on any algebraic structure where a sum is defined.
So, we can write for representing even though the summing terms aren’t integers. If we wanted to sum all the fifth roots of unity (complex numbers) we could write .
There are several variations to the notation. Often the starting and ending values for the running parameter are ommited if the set of values it can take is not relevant or is understood from context. So on some contexts one could see the sum
|
|
written as where the summation is understood from context to be done over all positive integers.
Also notice another variation in the preceding example: the upper limit is , which means the sum doesn’t stop after some terms. In other words, the previous example represents the sum
|
|
where there are an infinite number of summands.
Another variation is to give further specifications for the allowed values of the running parameter. So, if we wanted to sum if we wanted to sum the reciprocals of all prime numbers we could simply write
|
|
where we also use the previous variation where omitting the omiting starting and stopping values indicates summing over all possible values the context allows. Now, if we wanted to sum all prime numbers between and we have choices:
|
|
Evaluating sums
Since we are working with sums, all the usual properties (commutativity, associativity, etc) hold.
Two of the most useful formulas for dealing with summations are
|
|
|
(2) |
|
|
|
(3) |
The first property allows us to split summations into simpler sums, and the second tells us we can factor out any constant term (actually, any expression not involving the summation index).
We have also a “changing limits” property, which we used to give two different expressions for :
|
|
(4) |
where is any integer.
As example, supose we wanted to sum all the values for when runs from to . That is, we wish to evaluate .
By using the mentioneds properties we have
|
|
|
|
|
|
where context indicates that in all previous sums, runs from to . The problem now is reduced to find formulas for the sums in the last expression.
Notice also that, since is the same as we could have also done the following changes:
|
|
|
|
|
|
and again we are left with the task of evaluating a simpler summation.
Useful formulas
We now give formulas for evaluating many common summations, which can be combined using the mentioned properties to evaluate a wide range of sums.
Constants. The simplest case is when the summation terms do not involve the running variable. Two examples are:
|
|
which respectively represent the sums and . It’s obvious that if the summand does not depend on the running variable, all terms will be the same, and thus the sum will be the product of any summand by the nuber of summands. In other words,
|
|
Remark: If a summand does not depend on the summation index, we say it is constant (with respect the summation). So in the previous example was “constant” since it didn’t depend on the running variable , and thus
|
|
Small powers.
Suppose we wanted to calculate . In other words, we want to calculate . We can use the formula
|
|
which is credited to Gauss. Applying such formula we find that the sought answer is .
Notice that we can use the formula to evaluate sums of consecutive integers not necessarily at . For instance, if we wanted
we could proceed as following:
|
|
|
|
|
|
|
|
|
|
|
|
Similar formulas exist for evaluating sums of small powers of consecutive integers:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Arithmetic progressions.
The arithmetic progression is a sequence where the difference of each term and the previous is always the same. In other words, is of the form
|
|
(notice that the previous example has terms).
The corresponding sum can be written with sigma notation as
. We can use all formulas we have so far to calculate it:
|
|
|
|
|
|
|
|
|
If represent the terms of the progression, then we can also rewrite the last result as
|
|
A particular case of arithmetic sequence is summing consecutive odd (or consecutive even ) numbers, since the common difference is always .
|
|
|
|
|
|
|
|
Geometric progressions.The geometric progression is a sequence where the quotient between each term and the previous is always the same. in other words, has the form:
|
|
The corresponding sum can be reduced to calculating by factoring out of the summation. The corresponding formula is
|
|
A particularly nice formula is obtained when :
|
|
So, in the old story about a chess board where the board is filled doubling the number of seeds on the previous position, the answer would be
|
|
When the common quotient has absolute value smaller than , we can actually calculate the infinite series:
|
|
Other formulas.
Many other formulas can be found to evaluate sums. Here is a small miscellanea of remarkable formulas.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
If denotes the -th Fibonacci number, then
|
|
|
|
|
|
|
|
|
Notes
The sigma notation was introduced by the French mathematician
Joseph Fourier in 1820 [1].
Comments
Hi all old mathematicians
Which is the value of the sum
SIGMA_{i = 1}^4 of 2k+1,
is it 21 or 24? I have always (in 44 years) seen only such a practice, that the summing operator, similarly as the deriving and integral operators, affects only the first term (or addend) on its right side. This implies e.g. that SIGMA x + SIGMA y does not mean double summing
SIGMA (a + SIGMA b).
Hi all old mathematicians (corrected)
Which is the value of the sum
SIGMA_{i = 1}^4 of 2i+1,
is it 21 or 24? I have always (in 44 years) seen only such a practice, that the summing operator, similarly as the deriving and integral operators, affects only the first term (or addend) on its right side. This implies e.g. that SIGMA x + SIGMA y does not mean double summing
SIGMA (a + SIGMA b).
Re: Hi all old mathematicians (corrected)
Hi pahio,
If I'm reading your notation correctly you want to calculate:
SIGMA{i=1..4} (2*i+1)? (i.e. (2*1+1) + (2*2+1) + (2*3+1) + (2*4+1))?
Basically we have two properties of sigma we can use:
SIGMA(a+b) = SIGMA (a) + SIGMA (b) [where the range remains the same]
and SIGMA(c*a) = c * SIGMA (a) where c is a constant
so SIGMA{i=1..4} (2*i+1) = 2*SIGMA{i=1..4} (i) + SIGMA {i=1..4} (1)
= 2*SIGMA{i=1..4} (i) + 4
= 2 * 10 + 4 [using SIGMA{i=1..n} (i) = (n*(n+1)/2)]
= 24.
So no, there is no SIGMA double summing as you had presented:
SIGMA (a + SIGMA b).
Karli
Re: Hi all old mathematicians (corrected)
and...
http://planetmath.org/?op=getobj&from=objects&id=6361
also gives these and other properties of SIGMA
Re: Hi all old mathematicians (corrected)
I would have said it is
(2*1+1) + (2*2+1) + (2*3+1) + (2*4+1) = 3+5+7+9 = 24.
I agree that the SIGMA stops being active if it encounters
another SIGMA, but I think that it continues to be active after a +,
by default.
But of course if one has the option, one can and should use parentheses
to be completely clear.
I've recently had to endure some pain due to EXPECTATION X^2 -- no parens!
Re: Hi all old mathematicians (corrected)
This reminds me of a saying
"write not to be understood, but so that you cannot be
misunderstood"
To make things precise, there should be parenthesis around
2i+1. Or if you really want to add one to the sum, then write
1 + \sum 2i
For simple sums, I think the below expressions are
unambigious:
1) b + \sum a_i
2) \sum a_i + b_i
(meaning \sum (a_i + b_i). This is implied by the
index in b_i)
3) \sum a_i + \sum b_i = (\sum a_i) + (\sum b_i)
(and not \sum (a_i + \sum b_i))
However, for any more comlpicated sums, I think that parentheses
should be used as much as necessary so that the sum is
readable. Clarity should be the aim.
Re: Hi all old mathematicians (corrected)
I usually consider the "big operators" (\sum, \bigcup, etc) having lower precedence than "small operators" (+, \cup, etc)
so SIGMA 2k + 1 I take it as all parent post did:
(2*1+1)+(2*2+1) + (2*3+1) etc
and as matte points, that's specially true when the summnds all involve the summation index
\sum a_k + b_k
makes no sense expanding as (\sum ak) + bk
HOWEVER in case of doubt, and complex sums (well the example was a bit simple so it was understood out from context), it's much better to use parentheses
NOtice also that (on the top post), integral has the differential delimiting its scope, so it's not as good as analogy
f
G -----> H G
p \ /_ ----- ~ f(G)
\ / f ker f
G/ker f
Re: Hi older and younger mathematicians
Matte is right, and I agree with him [her?] -- one should strive for precision and unambiguity in mathematical expressions. Therefore one should use parentheses after a sum sign when one means to sum an expression with more than one "terms"; dropping the parentheses is thus in principle worse than using them (so I hope that here in PM we should not set bad examples in this thing; cf. "summation").
Another motive: WHY should the summing operator behave in different way as other operators, e.g. deriving operators (d/dx, D etc.), nabla, integral operators? These all require parentheses for affecting sums and differences -- d/dx sin2x + cos3x is not same d/dx (sin2x + cos3x) in spite of the common variable x.
Jussi
Re: Hi older and younger mathematicians
Don't get mad at me, but if I wanted to mean
(\sum 2k) + 1 I would write it in THAT particular way or as matte sugests
1+\sum 2k
and I think it's customary to understand that a summation "closes" revious summations
so \sum 2k + \sum 1 is not \sum (2k + \sum 1)
I ALSO said that when in doubt and/or complicated expressions, parenthesis should be used for the sake of clarity.
But let's not be too pedantic, and I don't think my entry sets a bad example or it's confusing (unless you WANT to be confused)
Notice all the first posters (stux and jac) that answered the original question said it was 24 so that means it's how a given mathematician would understand it out of context.
And I guess the particular place that bothers you was understood the proper way by everyone who looked at it.
HOWEVER, I'll grant you write access to ALL of my entries so you can fix whatever you take in consideration (so you don't think I'm stubborn or maliciously trying to confuse readers)
f
G -----> H G
p \ /_ ----- ~ f(G)
\ / f ker f
G/ker f
Re: Hi older and younger mathematicians
We all have seen that the use of parentheses is a matter of taste -- e.g. drini and I evidently have the opposite tastes =o) I know that its always dangerous to dispute of such matters and hope that I have not made drini angry.
I have wanted to bring up my pedantic point of view, which is based on the similar behaving of operators. The cause was that I have in PM seen in two places the practice without parentheses (it shocked me since I have not before seen such, or do not remember such).
All in all, it is good that we discuss also the use of parentheses -- it belongs to mathematics.
Jussi
Re: Hi older and younger mathematicians
An alternative to paretheses is a clearly stated convention.
If we agree that ^ has greater precidence than +, for example,
there is no need to parethesize 2+2^3. Otherwise, if we don't
agree, then there is potential for confusion.
Aaron has an entry called OrderOfOperations, I think this would
be the correct place to take up discussion of the conventions
used for SIGMA (and differentiation, etc.) on PlanetMath.
Re: Hi older and younger mathematicians
Hi guys,
I wouldn't be surprised if there is already a clearly established convention for handling order of operations when the SIGMA or \sum operation is involved. However after a quick search I have not found reference to this topic.
However I do beleive, as drini stated, that the established convention is to give \sum a lower operator precedence than '+'. That means in the same way 2^3+4=(2^3)+4 differentiates 2^(3+4) (as you pointed out jac), \sum a + c should necessarily be understood as (\sum a) + c or c + (\sum a) as an clearer alternate notation drini suggested.
That said, it is my opinion, having \sum a_i + b_i (although understood to be part of \sum in context,) should be grouped by a parenthesis as \sum (a_i + b_i) for clarity.
An example of this can be seen in Wikipedia's entry for SERIES where they state an example as \sum (b_n-b_[n+1]) where the parenthesis is included for clarity.
The link to this is:
http://en.wikipedia.org/wiki/Series_%28mathematics%29#Examples
Also, I wanted to point out earlier that:
\sum (a + \sum b) would evaluate to: \sum a + \sum\sum b.
Re: Hi older and younger mathematicians
yes, but as matter commented, if
\sum_j a+b
if both a,b involve "j" (the summation index) then it makes sense the sum sign applying to both of them
f
G -----> H G
p \ /_ ----- ~ f(G)
\ / f ker f
G/ker f
Re: Hi older and younger mathematicians
Stux, I think you misspoke slightly...
"established convention is to give \sum a lower operator precedence than '+'"
yes, I agree.
But then
"\sum a + c should necessarily be understood as (\sum a) + c or c + (\sum a)"
does not make sense.
*Lower* precidence means sum last, and get \sum (a+c).
In the case of
\sum a + \sum b
(without parentheses), the above rule says we have
\sum (a + \sum b)
However, that is *not* always what is meant when the expression is
encountered in the literature! And I don't think one will frequently
see
(\sum a) + (\sum b)
even when that is what was meant. I'd have to say that the convention
that is actually employed in day-to-day math is actually more
complicated than simple operator precidence! But I think on PM, we
should only use one rule to determine where the parentheses: assume
everything in OrderOfOperations, and then add parentheses as needed.
Re: Hi older and younger mathematicians
jac,
You know what? You're absolutely right, I definitely did 'misspeak' (If that's a word at all,) about the operator precedence for \sum. I had to think about it for a second! I'm sorry. So yeah it wouldn't be lower precedence. So pretty much the convention employed is a little more complicated than order of operations, but I don't think it's by much:
Generally, multiplications and powers are kept within the \sum, so I'd say (in a preliminary attempt to formalize the convention), it would have a higher precedence than addition but lower than multiplication/division, etc. -- I haven't even touched Integration, etc. The exception would be what drini mentioned: that it would make sense that \sum a_i + b_i is iterpreted as \sum (a_i + b_i); (granted I prefer the latter version cuz its prettier ;) ).
I am curious to know if there is already some kind of paper or documentation formalizing the convention. I wish I could find something like that -- it would be very helpful.
Re: Hi older and younger mathematicians
Alright guys, your deep discussions on the scope of summations have borne fruit, although you might need a magnifying glass to see it. In the newly-added entry "proof of the multiplication formula for the gamma function" there is a summation in the exponent in the seventh equation. Thanks to you all, I was VERY, VERY, VERY CAREFUL to enclose the argument of that summation in parentheses lest there be confusion.
Pariuntur montes et nascitur ridicullisimus musculus.
checking accuracy: first example with infinity
While I'm no mathematician, I remain an interested observer. It seems to me that the example given above for summation of 1/2^k for k=1 to infinity is incorrect.
It is given as 1/1+1/2+1/4+1/8+... but should be 1/2+1/4+1/8+... since the series starts at k=1 and 1/2^1 = 1/2.
If the series had started at k=0, then 1/2^0 would give us 1/1 and thus the series that was printed (1/1+1/2+1/4+...) would have been correct.
Am I correct or did I miss something in analytic geometry?
Re: checking accuracy: first example with infinity
you're quite right. I fixed it.