A hierarchical clustering tool
- Comparison with other applications
MultiDendrograms is a simple yet powerful program to make the Hierarchical Clustering of real data, distributed under an Open Source license. Starting from a distances (or similarities) matrix, MultiDendrograms calculates its dendrogram using the most common Agglomerative Hierarchical Clustering algorithms, allows the tuning of many of the graphical representation parameters, and the results may be easily exported to file. A summary of characteristics:
- Multiplatform: developed in Java, runs in all operating systems (e.g. Windows, Linux and MacOS).
- Graphical user interface: data selection, hierarchical clustering options, dendrogram representation parameters, navigation across the dendrogram, deviation measures.
- Hierarchical Clustering algorithms: weighted and unweighted variable-group versions of Single Linkage, Complete Linkage, Arithmetic Linkage (UPGMA), Versatile Linkage, Centroid, Ward and Beta Flexible.
- Representation parameters: size, orientation, labels, axis, etc.
- Dendrogram measures: Tree Balance, Cophenetic Correlation Coefficient, Normalized Mean Squared Error, Normalized Mean Absolute Error and Space Distortion.
- Export: ultrametric matrix, dendrogram measures, dendrogram details in text, Newick and JSON tree formats.
- Plot: dendrogram image in JPG, PNG and EPS formats.
- Command-line: available direct calculation of hierarchical clustering from the command-line, without the need to use the graphical interface.
MultiDendrograms implements the variable-group algorithms in  to solve the non-uniqueness problem found in the standard pair-group algorithms and implementations. This problem arises when two or more minimum distances between different clusters are equal during the amalgamation process. The standard approach consists in choosing a pair, breaking the ties between distances, and proceeds in the same way until the final hierarchical classification is obtained. However, different clusterings are possible depending on the criterion used to break the ties (usually a pair is just chosen at random!), and the user is unaware of this problem.
The variable-group algorithms group more than two clusters at the same time when ties occur, given rise to a graphical representation called multidendrogram. Their main properties are:
- When there are no ties, the variable-group algorithms give the same results as the pair-group ones.
- They always give a uniquely determined solution.
- In the multidendrogram representation for the results one can explicitly observe the occurrence of ties during the agglomerative process. Furthermore, the height of any fusion interval (the bands in the program) indicates the degree of heterogeneity inside the corresponding cluster.
MultiDendrograms also introduces a new parameterized type of hierarchical clustering algorithm called Versatile Linkage, which includes Singles Linkage, Complete Linkage and Arithmetic Linkage as particular cases, and which naturally defines two new algorithms, Geometric Linkage and Harmonic Linkage (hence the convenience to rename UPGMA as Arithmetic Linkage, to emphasize the existence of different types of averages).
How do other applications deal with ties?
Ignore ties, uncommented in their respective manuals:
- Mathematica: Agglomerate and DirectAgglomerate functions in Hierarchical Clustering Package
- MATLAB: linkage function in the Statistics Toolbox
- R: hclust function in the stats package, and agnes function in the cluster package
- Stata: cluster and clustermat commands
Report the existence of ties, and break them using the order of the observations in the input file:
- SAS: CLUSTER procedure
Break ties using the order of cases in the input file, and recommend the comparison with cases sorted in different random orders:
- SPSS Statistics: Hierarchical Clustering Analysis procedure
How do I know if there are ties in my data?
- Most people would say I do not have problems with tied distances, however you cannot be sure unless the used software explicitly tells you so.
- In MultiDendrograms tied distances can be easily noticed in the dendrogram plots, in the dendrogram navigation window, and in the exported tree files.
How many binary dendrograms may correspond to one MultiDendrogram?
- 6 binary dendrograms for Table 3 in Fatahi et al, Vitis 42 (2003) 185–192.
- 36 binary dendrograms for Supplementary Table 2 in Zdunić et al, Am. J. Enol. Vitic. 64 (2013) 285-290.
- 17900 binary dendrograms for Table 2 in Ibáñez et al, Am. J. Enol. Vitic. 54 (2003) 22–30.
760590880 binary dendrograms in Almadanim et al, Vitis 46 (2007) 116–119.
- You may use the Hierarchical_Clustering program in Radatools to count how many binary dendrograms correspond to your data.
Solving Non-uniqueness in Agglomerative Hierarchical Clustering Using Multidendrograms
Alberto Fernández and Sergio Gómez
Journal of Classification 25 (2008) 43-65
(pdf) (doi) (Springer)
Please cite  if you use MultiDendrograms in your publications:
- Program (manual included): multidendrograms-5.0.3.zip
- Manual: multidendrograms-5.0-manual.pdf
- Source code: multidendrograms-5.0.3-src.zip and at the GitHub repository
Alternatively, you may use the Hierarchical_Clustering program in Radatools, which is able to calculate MultiDendrograms and also to enumerate or count the corresponding Binary Dendrograms.
No installation needed, just unzip multidendrograms-xxx.zip and run multidendrograms.bat (Windows), multidendrograms.sh (Linux) or multidendrograms.jar (all OS). Java version 6 (also known as Java 1.6) or higher is required.
You may contribute to the development of MultiDendrograms in GitHub:
- GitHub repository: sergio-gomez / MultiDendrograms
- Reorganization of clustering algorithms
- New parameterized Versatile Linkage and Beta Flexible clustering algorithms
- New Geometric Linkage and Harmonic Linkage clustering algorithms
- Calculation of tree balance and space distortion
- Save dendrogram measures to file
- Export dendrograms to JSON format
- Graphical user interface at different sizes
- Positive and negative distances and similarities
- Uniform and non-uniform origin of nodes
- Improved configuration file
- Translation to German
- Improved performance
- New format for dendrogram navigation and save as text file
- Data in triangular form
- Scrollbars in dendrograms panel
- Command-line direct calculation of multidendrogram
- Ward hierarchical clustering
- Check if new version is available
- Confirmation before closing
- Improved performance
- Major source code refactoring
- Export dendrograms to Newick format
- Show calculation progress
- Improved GUI
- Improved performance
- Completely new multiplatform (Windows, Linux, MacOS, etc.) application
- Added Graphical User Interface (GUI)
- Control of the dendrogram appearance
- Navigation through the dendrogram details
- Accepts distance and similarity matrices
- Export dendrograms to JPG, PNG and EPS
- Calculation of ultrametric deviation measures
- Windows command-line application to compute multidendrograms
- Windows command-line application to compute ultrametric matrices
- Windows command-line application to generate EPS plots