FLAME clustering

The FLAME algorithm is mainly divided into three steps:

1. Extraction of the structure information from the dataset:
   1. Construct a neighborhood graph to connect each object to its K-Nearest Neighbors (KNN);
   2. Estimate a density for each object based on its proximities to its KNN;
   3. Objects are classified into 3 types:
      1. Cluster Supporting Object (CSO): object with density higher than all its neighbors;
      2. Cluster Outliers: object with density lower than all its neighbors, and lower than a predefined threshold;
      3. the rest.
2. Local/Neighborhood approximation of fuzzy memberships:
   1. Initialization of fuzzy membership:
      1. Each CSO is assigned with fixed and full membership to itself to represent one cluster;
      2. All outliers are assigned with fixed and full membership to the outlier group;
      3. The rest are assigned with equal memberships to all clusters and the outlier group;
   2. Then the fuzzy memberships of all type 3 objects are updated by a converging iterative procedure called Local/Neighborhood Approximation of Fuzzy Memberships, in which the fuzzy membership of each object is updated by a linear combination of the fuzzy memberships of its nearest neighbors.
3. Cluster construction from fuzzy memberships in two possible ways:
   1. One-to-one object-cluster assignment, to assign each object to the cluster in which it has the highest membership;
   2. One-to-multiple object-clusters assignment, to assign each object to the cluster in which it has a membership higher than a threshold.

The Local/Neighborhood Approximation of Fuzzy Memberships is a procedure to minimize the Local/Neighborhood Approximation Error (LAE/NAE) defined as the following:

${\displaystyle E(\{{\boldsymbol {p}}\})=\sum _{{\boldsymbol {x}}\in {\boldsymbol {X}}}{\bigg \|}{\boldsymbol {p(x)}}-\sum _{\boldsymbol {y\in {\mathcal {N}}(x)}}w_{\boldsymbol {xy}}{\boldsymbol {p(y)}}{\bigg \|}^{2}}$

where ${\displaystyle {\boldsymbol {X}}}$ is the set of all type 3 objects, ${\displaystyle {\boldsymbol {p(x)}}}$ is the fuzzy membership vector of object ${\displaystyle {\boldsymbol {x}}}$, ${\displaystyle {\mathcal {N}}(x)}$ is the set of nearest neighbors of ${\displaystyle {\boldsymbol {x}}}$, and ${\displaystyle w_{\boldsymbol {xy}}}$ with ${\displaystyle \sum _{\boldsymbol {y\in {\mathcal {N}}(x)}}w_{\boldsymbol {xy}}=1}$ are the coefficients reflecting the relative proximities of the nearest neighbors.

The NAE can be minimized by solving the following linear equations with unique solution which is the unique global minimum of NAE with value zero:

${\displaystyle p_{k}({\boldsymbol {x}})-\sum _{\boldsymbol {y\in {\mathcal {N}}(x)}}w_{\boldsymbol {xy}}p_{k}({\boldsymbol {y}})=0,\quad \forall {{\boldsymbol {x}}\in {\boldsymbol {X}}},\quad k=1,...,M}$

where ${\displaystyle M}$ is the number of CSOs plus one (for the outlier group). The following iterative procedure can be used to solve these linear equations:

${\displaystyle {{\boldsymbol {p}}^{t+1}({\boldsymbol {x}})}=\sum _{\boldsymbol {y\in {\mathcal {N}}(x)}}w_{\boldsymbol {xy}}{{\boldsymbol {p}}^{t}({\boldsymbol {y}})}}$

• Data clustering
• Fuzzy clustering

• BMC Bioinformatics (2007): FLAME, a novel fuzzy clustering method for the analysis of DNA microarray data
• FLAME source codes in C released under FreeBSD-like license on GoogleCode