Geometric median

From Wikipedia, the free encyclopedia

The geometric median of a discrete set of sample points in a Euclidean space is the point minimizing the sum of distances to the sample points. This generalizes the median, which has the property of minimizing the sum of distances for one-dimensional data, and provides a central tendency in higher dimensions. It is also known as the Fermat–Weber point or 1-median.[1]

The geometric median is an important estimator of location in statistics. It is also a standard problem in facility location, where it models the problem of locating a facility to minimize the cost of transportation.

The special case of the problem for three points in the plane (that is, m = 3 and n = 2) is sometimes also known as Fermat's problem; it arises in the construction of minimal Steiner trees, and was originally posed as a problem by Pierre de Fermat to Evangelista Torricelli, who solved it. Its solution is now known as the Fermat point of the triangle formed by the three sample points. Alfred Weber's name is associated with the more general Fermat–Weber problem due to a discussion of the problem in his 1909 book on facility location.

Wesolowsky (1993) provides a survey of the problem. See Fekete, Mitchell, and Beurer (2003) for generalizations of the problem to non-discrete point sets.

Contents

Formally, for given a set of m points x_1, x_2, \dots, x_m\, with each x_i \in \mathbb{R}^n, the geometric median is defined as

Geometric Median =\underset{y \in \mathbb{R}^n}{\operatorname{argmin}} \sum_{i=1}^m \left \| x_i-y \right \|

Note that argmin means the argument for which the sum is minimized. In this case, it is the point y from where the sum of all Euclidean distances to the xi's is minimum.

  • For the 1-dimensional case, the geometric median coincides with the median. This is because the univariate median also minimizes the sum of distances from the points.
  • The geometric median is unique whenever the points are not collinear.
  • The geometric median is equivariant for Euclidean similarity transformations, including translation and rotation. This means that one would get the same result either by transforming the geometric median, or by applying the same transformation to the sample data and finding the geometric median of the transformed data. This property follows from the fact that the geometric median is defined only from pairwise distances, and doesn't depend on the system of orthogonal Cartesian coordinates by which the sample data is represented. In contrast, the component-wise median for a multivariate data set is not in general rotation invariant, nor is it independent of the choice of coordinates.
  • The geometric median has a breakdown point of 0.5.[2] That is, up to half of the sample data may be arbitrarily corrupted, and the median of the samples will still provide a robust estimator for the location of the uncorrupted data.

  • For 3 points, if any angle of the triangle is more than 120° then the geometric median is the point making that angle. If all the angles are less than 120°, the geometric median is the point inside the triangle which subtends an angle of 120° to all three pairs of points. This is also known as the Fermat point of the triangle formed by the three points.
  • For 4 coplanar points, if a point is inside the triangle formed by the other three points, then the geometric median is that point. Otherwise, the points form a convex quadrilateral and the geometric median is where the diagonals of the quadrilateral intersect. This is also known as the Radon point of the four points.

Despite being an easy to understand concept, computing the geometric median poses a challenge. The centroid or center of mass, defined similarly to the geometric median as minimizing the sum of the squares of the distances to each sample, can be found by a simple formula — its coordinates are the averages of the coordinates of the samples — but no such formula is known for the geometric median, and it has been shown that no formula involving only arithmetic operations and kth roots can exist in general.[3]

However, it is straightforward to calculate an approximation to the geometric median using an iterative procedure in which each step produces a more accurate approximation. Procedures of this type can be derived from the fact that the sum of distances is a convex function, since the distance to each sample point is convex and the sum of convex functions remains convex. Therefore, procedures that decrease the sum of distances at each step cannot get trapped in a local optimum.

One common approach of this type, called Weiszfeld's algorithm[4], defines a set of weights that are inversely proportional to the distances from the current estimate to the samples, and creates a new estimate that is the weighted average of the samples according to these weights. That is,

\left. y_{i+1}=\left( \sum_{j=1}^m \frac{x_j}{\| x_j - y_i \|} \right) \right/ \left( \sum_{j=1}^m \frac{1}{\| x_j - y_i \|} \right).

Bose et al (2003) describe more sophisticated geometric optimization procedures for finding approximately optimal solutions to this problem.

If y is distinct from all the given points, xj, then y is the geometric median if and only if it satisfies:

0 = \sum_{j=1}^m \frac {x_j - y} {\left \| x_j - y \right \|}.

This is equivalent to:

\left. y = \left( \sum_{j=1}^m \frac{x_j}{\| x_j - y \|} \right) \right/ \left( \sum_{j=1}^m \frac{1}{\| x_j - y \|} \right)

which is closely related to Weiszfeld's algorithm.

If y is equal to some of the given points, then y is the geometric median if and only if there are vectors uj such that:

0 =  \sum_{j=1}^m u_j

where for xjy,

u_j = \frac {x_j - y} {\left \| x_j - y \right \|}

and for xj = y,

\| u_j \| \leq 1 .

  1. ^ The more general k-median problem asks for the location of k cluster centers minimizing the sum of distances from each sample point to its nearest center.
  2. ^ Lopuhaä and Rousseeuw (1991).
  3. ^ Cockayne and Melzak (1969); Bajaj (1988).
  4. ^ Weiszfeld (1937); Kuhn (1973); Chandrasekaran and Tamir (1989).

  • Bajaj, C. (1988). "The algebraic degree of geometric optimization problems". Discrete and Computational Geometry 3: 177–191. DOI:10.1007/BF02187906. 
  • Chandrasekaran, R.; Tamir, A. (1989). "Open questions concerning Weiszfeld's algorithm for the Fermat-Weber location problem". Mathematical Programming, Series A 44: 293–295. 
  • Cockayne, E. J.; Melzak, Z. A. (1969). "Euclidean constructability in graph minimization problems.". Mathematics Magazine 42: 206–208. 
  • Fekete, Sándor P.; Mitchell, Joseph S. B.; Beurer, Karin (2003). "On the continuous Fermat-Weber problem". arXiv:cs.CG/0310027. 
  • Kuhn, H. W. (1973). "A note on Fermat's problem". Mathematical Programming 4: 98–107. 
  • Weber, Alfred (1909). Über den Standort der Industrien, Erster Teil: Reine Theorie des Standortes. Tübingen: Mohr. 
  • Wesolowsky, G. (1993). "The Weber problem: History and perspective". Location Science 1: 5–23. 
  • Weiszfeld, E. (1937). "Sur le point pour lequel la somme des distances de n points donnes est minimum". Tohoku Math. Journal 43: 355–386. 
Advanced Search
Included Web Search Engines


Safe Search

close

Top Matching Results

Occasionally Search.com will highlight specialized results that are based on the context of your query. Examples of specialized results include specific links to news, images, or video.

Top Matching Results may highlight information from other Search.com pages, content from the CNET Network of sites, or third party content. The listings are based purely on relevance. Search.com does not receive payment for listings in this section but our partners that provide this data may get paid for listing these products.

Sponsored Links

This section contains paid listings which have been purchased by companies that want to have their sites appear for specific search terms and related content. These listings are administered, sorted and maintained by a third party and are not endorsed by Search.com.

Search Results

Search.com sends your search query to several search engines at one time and integrates the results into one list which has been sorted by relevance using Search.com's proprietary algorithm. You can customize the list of search engines included in your metasearch from the preferences.

The search engines that are used in your metasearch may allow companies to pay to have their Web sites included within the results. To view the Paid Inclusion policy for a specific search engine, please visit their Web site. Search.com does not accept payment or share revenue with any search engine partner for listings in this section.