Convex function

From Wikipedia, the free encyclopedia

(Redirected from Convex (function))
Jump to: navigation, search

In mathematics, a real-valued function f defined on an interval (or on any convex subset of some vector space) is called convex, or concave up, if for any two points x and y in its domain C and any t in [0,1], we have

f(tx+(1-t)y)\leq t f(x)+(1-t)f(y).
Convex function on an interval.
Convex function on an interval.

In other words, a function is convex if and only if its epigraph (the set of points lying on or above the graph) is a convex set.

A function is called strictly convex if

f(tx+(1-t)y) < t f(x)+(1-t)f(y)\,

for any t in (0,1) and x \neq y.

A function f is said to be concave if f is convex.

Contents

A function (in blue) is convex if and only if the region above its graph (in green) is a convex set.
A function (in blue) is convex if and only if the region above its graph (in green) is a convex set.

A convex function f defined on some open interval C is continuous on C and differentiable at all but at most countably many points. If C is closed, then f may fail to be continuous at the endpoints of C.

A continuous function on an interval C is convex if and only if

f\left( \frac{x+y}{2} \right) \le  \frac{f(x)+f(y)}{2}

for all x and y in C.

A differentiable function of one variable is convex on an interval if and only if its derivative is monotonically non-decreasing on that interval.

A continuously differentiable function of one variable is convex on an interval if and only if the function lies above all of its tangents: f(y) ≥ f(x) + f '(x) (yx) for all x and y in the interval. In particular, if f '(c) = 0, then c is a global minimum of f(x).

A twice differentiable function of one variable is convex on an interval if and only if its second derivative is non-negative there; this gives a practical test for convexity. If its second derivative is positive then it is strictly convex, but the converse does not hold, as shown by f(x) = x4.

More generally, a continuous, twice differentiable function of several variables is convex on a convex set if and only if its Hessian matrix is positive semidefinite on the interior of the convex set.

Any local minimum of a convex function is also a global minimum. A strictly convex function will have at most one global minimum.

For a convex function f, the sublevel sets {x | f(x) < a} and {x | f(x) ≤ a} with aR are convex sets. However, a function whose sublevel sets are convex sets may fail to be a convex function; such a function is called a quasiconvex function.

Jensen's inequality applies to all convex functions. If x is random, taking values in some domain  \mathcal{F} , then E f(x) \geq f(Ex).

  • If f and g are convex functions, then so are h(x) = max{f(x),g(x)} and h(x) = f(x) + g(x).
  • If f and g are convex functions and if g is increasing, then h(x) = g(f(x)) is convex.
  • Convexity is invariant under affine maps: that is, if f(x) is convex with x\in\mathbb{R}^n, then so is g(y) = f(Ay + b), where A\in\mathbb{R}^{n \times m},\; b\in\mathbb{R}^n.
  • If f(x,y) is convex in (x,y) and C is a convex nonempty set, then g(x) = \inf_{y\in C} f(x,y) is convex in x, provided g(x) > -\infty for some x.

  • The second derivative of x2 is 2; it follows that x2 is a convex function of x.
  • The absolute value function |x| is convex, even though it does not have a derivative at x = 0.
  • The function f with domain [0,1] defined by f(0)=f(1)=1, f(x)=0 for 0<x<1 is convex; it is continuous on the open interval (0,1), but not continuous at 0 and 1.
  • The function x3 has second derivative 6x; thus it is convex for x ≥ 0 and concave for x ≤ 0.
  • Every linear transformation to \mathbb{R} is convex but not strictly convex, since if f is linear, then f(a + b) = f(a) + f(b). This statement still holds if we replace "convex" by "concave".
  • An affine function to \mathbb{R}, i.e. a function of the form f(x) = aTx + b, is simultaneously convex and concave.
  • All norms are convex by the triangle inequality.
  • If f is convex, the perspective function g(x,t) = tf(x / t) is convex for t > 0.
  • Examples of functions that are monotonically increasing but not convex include \sqrt x and log(x).
  • Examples of functions that are convex but not monotonically increasing include x2 and -x.
  • The function f(x) = 1/x is convex on the interval (0,+∞), but not on the interval (-∞,+∞), because of the singularity at x = 0.

  • Rockafellar, R. T. (1970). Convex analysis. Princeton: Princeton University Press. 
  • Luenberger, David (1984). Linear and Nonlinear Programming. Addison-Wesley. 
  • Luenberger, David (1969). Optimization by Vector Space Methods. Wiley & Sons. 
  • Bertsekas, Dimitri (2003). Convex Analysis and Optimization. Athena Scientific. 
  • Hiriart-Urruty, Jean-Baptiste, and Lemaréchal, Claude. (2004). Fundamentals of Convex analysis. Berlin: Springer.
  • Krasnosel'skii M.A., Rutickii Ya.B. (1961). Convex Functions and Orlicz Spaces. Groningen: P.Noordhoff Ltd. 
  • Borwein, Jonathan, and Lewis, Adrian. (2000). Convex Analysis and Nonlinear Optimization. Springer.

Advanced Search
Included Web Search Engines


Safe Search

close

Top Matching Results

Occasionally Search.com will highlight specialized results that are based on the context of your query. Examples of specialized results include specific links to news, images, or video.

Top Matching Results may highlight information from other Search.com pages, content from the CNET Network of sites, or third party content. The listings are based purely on relevance. Search.com does not receive payment for listings in this section but our partners that provide this data may get paid for listing these products.

Sponsored Links

This section contains paid listings which have been purchased by companies that want to have their sites appear for specific search terms and related content. These listings are administered, sorted and maintained by a third party and are not endorsed by Search.com.

Search Results

Search.com sends your search query to several search engines at one time and integrates the results into one list which has been sorted by relevance using Search.com's proprietary algorithm. You can customize the list of search engines included in your metasearch from the preferences.

The search engines that are used in your metasearch may allow companies to pay to have their Web sites included within the results. To view the Paid Inclusion policy for a specific search engine, please visit their Web site. Search.com does not accept payment or share revenue with any search engine partner for listings in this section.