PlanetMath: hyperplane separation

Main Menu

sections Encyclopædia
Papers
Books
Expositions

meta Requests (232)
Orphanage
Unclass'd
Unproven (519)
Corrections (23)
Classification

talkback Polls
Forums
Feedback
Bug Reports

downloads Snapshots
PM Book

information News
Docs
Wiki
ChangeLog
TODO List
Legalese
About

Entry average rating: No information on entry rating

hyperplane separation

(Theorem)

Let be a vector space, and $\Phi$ be any subspace of linear functionals on . Impose on the weak topology generated by $\Phi$ .

Theorem 1 (Hyperplane Separation Theorem I) Given a weakly closed convex subset $S \subset X$ , and $a \in X \setminus S$ . there is $\phi \in \Phi$ such that

$\displaystyle \phi(a) < \inf_{x \in S} \phi(x)\,.$

Proof. The weak topology on

can be generated by the semi-norms $x \mapsto \lvert p(x) \rvert$ for $p \in \Phi$ . A subbasis for the weak topology consists of neigborhoods of the form $\{ x \in X \colon \lvert p(x-y)\rvert < \epsilon \}$ for $y \in X$ , $p \in \Phi$ and $\epsilon > 0$ . Since $X \setminus S$ is weakly open, there exist $f_1, \dotsc, f_n \in \Phi$ and $\epsilon > 0$ such that

$\displaystyle \lvert f_i(x) - f_i(a)\rvert = \lvert f_i(x-a)\rvert < \epsilon \,,$ for all $i=1, \dotsc, n$ implies $\displaystyle x \in X \setminus S\,.$

In other words, if $x \in S$ then at least one of $\lvert f_i(x) - f_i(a)\rvert$ is $\geq \epsilon$ .

Define a map $F\colon X \to \mathbb{R}^n$ by $F(x) = ( f_1(x), \dotsc, f_n(x) )$ . The set $\overline{F(S)}$ is evidently closed and convex in $\mathbb{R}^n$ , a Hilbert space under the standard inner product. So there is a point $b \in \overline{F(S)}$ that minimizes the norm $\lVert b - F(a)\rVert$ .

It follows that $\langle {y-b}, {b-F(a)} \rangle \geq 0$ for all $y \in \overline{F(S)}$ ; for otherwise we can attain a smaller value of the norm by moving from the point along a line towards . (Formally, we have $0 \leq \left.\frac{d}{dt}\right\vert _{t=0} \lVert ty + (1-t)b - F(a)\rVert ^2 = 2\langle {y-b}, {b-F(a)} \rangle$ .)

Take $\phi = \sum_{i=1}^n \lambda_i f_i$ where $\lambda = b-F(a)$ . Then we find, for all $x \in S$ ,

$\displaystyle \phi(x-a)$	$\displaystyle = \langle {b - F(a)}, {F(x-a)} \rangle$
	$\displaystyle = \langle {b-F(a)}, {b-F(a)} \rangle + \langle {b-F(a)}, {y-b} \rangle \,, \quad y = F(x) \in \overline{F(S)}$
	$\displaystyle \geq \lVert b-F(a)\rVert ^2 + 0 \geq \epsilon^2\,. \qedhere$

$\qedsymbol$

Theorem 2 (Hyperplane Separation Theorem II) Let $S \subset X$ be a weakly closed convex subset, and $K \subset X$ a compact convex subset, that do not intersect each other. Then there exists $\phi \in \Phi$ such that

$\displaystyle \sup_{y \in K} \phi(y) < \inf_{x \in S} \phi(x)\,.$

Proof. We show that $S - K = \{ x - y \colon x \in S\,, y \in K\}$ is weakly closed in

. Let $\{ z_\alpha = x_\alpha - y_\alpha\} \subseteq A$ be a net convergent to

. Since

is compact, $\{ y_\alpha \}$ has a subnet $\{ y_{\alpha(\beta)} \}$ convergent to $y \in K$ . Then the subnet $x_{\alpha(\beta)} = z_{\alpha(\beta)} + y_{\alpha(\beta)}$ is convergent to

. The point

is in

since

is closed; therefore

is in

Also, is convex since and are. Noting that $0 \notin S-K$ (otherwise and would have a common point), we apply the previous theorem to obtain a $\phi \in \Phi$ such that

$\displaystyle 0 = \phi(0) < \inf_{z \in S-K} \phi(z) \leq \phi(x-y) \,,$ for all $x \in S$ and $y \in K$ .

The desired conclusion follows at once. $\qedsymbol$

"hyperplane separation" is owned by stevecheng.

(view preamble | get metadata)

Other names:

separating hyperplane

This object's parent.

Log in to rate this entry.
(view current ratings)

Cross-references: conclusion, subnet, convergent, net, intersect, compact, line, norm, point, inner product, Hilbert space, convex, map, open, subbasis, semi-norms, convex subset, closed, separation, generated by, weak topology, linear functionals, subspace, vector space
There is 1 reference to this entry.

This is version 1 of hyperplane separation, born on 2007-06-24.
Object id is 9667, canonical name is HyperplaneSeparation.
Accessed 1431 times total.

Classification:

AMS MSC:	46A55 (Functional analysis :: Topological linear spaces and related structures :: Convex sets in topological linear spaces; Choquet theory)
	49J27 (Calculus of variations and optimal control; optimization :: Existence theories :: Problems in abstract spaces)
	46A20 (Functional analysis :: Topological linear spaces and related structures :: Duality theory)

Pending Errata and Addenda

None.

Discussion

forum policy

No messages.

Interact