UniFeat | Feature Selection Algorithms

Feature Selection Algorithms

UniFeat is a collection of well-known and state-of-the-art feature selection methods. The description of the current feature selection methods in the repository of UniFeat is listed in the following table.

Version 0.1.1 September 2022

Method

Filter / Wrapper / Embedded

Supervised / Unsupervised

Reference
Information gain

Filter

Supervised

M. Mitchell, "Machine Learning".
Gain ratio

Filter

Supervised

M. Mitchell, "Machine Learning".
Symmetrical uncertainty

Filter

Supervised

H. Liu and H. Motoda, "Computational methods of feature selection".
Fisher score

Filter

Supervised

Q. Gu, Z. Li, and J. Han, "Generalized fisher score for feature selection".
Gini index

Filter

Supervised

W. Shang, H. Huang, H. Zhu, Y. Lin, Y. Qu, and Z. Wang, "A novel feature selection algorithm for text categorization".
mRMR

Filter

Supervised

H. Peng, F. Long, and C. Ding, "Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy".
Laplacian score

Filter

Supervised & Unsupervised

X. He, D. Cai, and P. Niyogi, "Laplacian score for feature selection".
RRFS

Filter

Supervised & Unsupervised

A. J. Ferreira and M. A. T. Figueiredo, "An unsupervised approach to feature discretization and selection".
Term variance

Filter

Unsupervised

L. Liu, J. Kang, J. Yu, Z. Wang, "A comparative study on unsupervised feature selection methods for text clustering".
Mutual correlation

Filter

Unsupervised

M. Haindl, P. Somol, D. Ververidis, and C. Kotropoulos, "Feature selection based on mutual correlation".
Random subspace method

Filter

Unsupervised

C. Lai, M. J. T. Reinders, and L. Wessels, "Random subspace method for multivariate feature selection".
UFSACO

Filter

Unsupervised

S. Tabakhi, P. Moradi, and F. Akhlaghian, "An unsupervised feature selection algorithm based on ant colony optimization".
RRFSACO_1

Filter

Unsupervised

S. Tabakhi and P. Moradi, "Relevance–redundancy feature selection based on ant colony optimization".
RRFSACO_2

Filter

Unsupervised

S. Tabakhi and P. Moradi, "Relevance–redundancy feature selection based on ant colony optimization".
IRRFSACO_1

Filter

Unsupervised

S. Tabakhi and P. Moradi, "Relevance–redundancy feature selection based on ant colony optimization".
IRRFSACO_2

Filter

Unsupervised

S. Tabakhi and P. Moradi, "Relevance–redundancy feature selection based on ant colony optimization".
MGSACO

Filter

Unsupervised

S. Tabakhi, A. Najafi, R. Ranjbar, and P. Moradi, "Gene selection for microarray data classification using a novel ant colony optimization".
Binary particle swarm optimization (BPSO)

Wrapper

Supervised

B. Xue, "Particle Swarm Optimisation for Feature Selection [Ph.D thesis]".
Continuous particle swarm optimization (CPSO)

Wrapper

Supervised

B. Xue, "Particle Swarm Optimisation for Feature Selection [Ph.D thesis]".
Particle swarm optimization version 4-2 (PSO(4-2))

Wrapper

Supervised

B. Xue, M. Zhang, and W. N. Browne, "Particle swarm optimisation for feature selection in classification: Novel initialisation and updating mechanisms".
HPSO-LS

Wrapper

Supervised

P. Moradi and M. Gholampour, "A hybrid particle swarm optimization for feature subset selection by integrating a novel local search strategy".
Simple GA

Wrapper

Supervised

F. T. Hussein, "Genetic algorithm for feature selection and weighting for off-line character recognition".
HGAFS

Wrapper

Supervised

Md. M. Kabir, Md. Shahjahan, and K. Murase, "A new local search based hybrid genetic algorithm for feature selection".
Optimal ACO

Wrapper

Supervised

M. H. Aghdam, N. Ghasem-Aghaee, and M. E. Basiri, "Text feature selection using ant colony optimization".
Decision tree based method

Embedded

Supervised

T. N. Lal, O. Chapelle, J. Weston, and A. Elisseeff, "Embedded Methods".
Random forest

Embedded

Supervised

L. Breiman, "Random Forests".
SVM_RFE

Embedded

Supervised

I. GUYON, J. WESTON, S. BARNHILL, and V. VAPNIK, "Gene Selection for Cancer Classification using Support Vector Machines".
MSVM_RFE

Embedded

Supervised

K. B. Duan, J. C. Rajapakse, H. Wang, and F. Azuaje, "Multiple SVM-RFE for Gene Selection in Cancer Classification With Expression Data".
OVO_SVM_RFE

Embedded

Supervised

K. B. Duan, J. C. Rajapakse, and M. N. Nguyen, "One-Versus-One and One-Versus-All Multiclass SVM-RFE for Gene Selection in Cancer Classification".
OVA_SVM_RFE

Embedded

Supervised

K. B. Duan, J. C. Rajapakse, and M. N. Nguyen, "One-Versus-One and One-Versus-All Multiclass SVM-RFE for Gene Selection in Cancer Classification".