When the number of features is large, kNN should use _______.

Question

BlackTom AI · Accepted Answer

Question restatement: When the number of features is large, kNN should use _______.

Option 1: 'multiple kernel functions' — This option refers to kernel methods used in algorithms like SVM or kernelized learning. kNN is a instance-based method that relies on distance metrics between data points, not kernel functions. Using multiple kernels is not a standard or practical requirement for kNN, so this is not appropriate.

Option 2: 'the Gram matrix' — The Gram matrix captures pairwise inner products and is central to kernel methods or certain linear algorithms, not to the kNN approach itself. Since kNN computes distances directly between samples, forming a Gram matrix is not a typical step in kNN prediction, making this choice unsuitable.

Option 3: 'Manhattan distance' — This suggests using the L1 distance measure. In high-dimensional spaces (large number of features), some distances like Euclidean can become less informative due to the concentration phenomenon, where distances between points tend to become similar. The Manhattan distance can sometimes maintain discriminative power by summing absolute feature differences, and it is often preferred in high-dimensional, sparse, or noisy feature settings. This makes it a reasonable recommendation for kNN with many features.

Option 4: 'Euclidean distance' — The standard choice in many kNN applications, but in very high-dimensional spaces Euclidean distance can suffer from reduced discrimination because distances tend to concentrate; all features contribute, including noisy or irrelevant ones, which can degrade performance. Therefore, while common, it may be less robust than Manhattan distance in some high-feature scenarios.

Putting the pieces together, in the context of many features, the rationale favors a distance metric that can be more robust to high dimensionality and sparsity. Manhattan distance (L1) often performs better than Euclidean (L2) under those conditions, and it is not tied to kernel methods or Gram matrices, which are not intrinsic to kNN.

Summary of the reasoning for each option:
- Multiple kernel functions: not aligned with kNN's distance-based paradigm; kernels belong to other algorithms.
- The Gram matrix: irrelevant to basic kNN distance computations and not used for prediction in standard kNN.
- Manhattan distance: aligns with high-dimensional robustness considerations and is a sensible choice for kNN with many features.
- Euclidean distance: common but can be less robust in high-dimensional spaces due to distance concentration; may underperform compared to Manhattan in some high-feature cases.

Overall takeaway: In the setting of a large number of features, using Manhattan distance is favored for kNN because it can provide better discrimination when many dimensions are involved, whereas the other options do not fit the kNN distance-based framework or are less suitable under high dimensionality.

When the number of features is large, kNN should use _______.单项选择题

类似问题

In a k-Nearest Neighbors algorithm, similarity of records is based on the .

Some of the formulae that we have come across in Chapters 6 & 7 are listed below. Match each of these to the name they are most commonly known by, assuming two instances a and b and an m-dimensional feature space.

Which of the following distance metrics is particularly effective for high-dimensional data but less interpretable compared to other metrics?

Question at position 8 An excess of growth hormone (GH) before puberty can result in the development ofgigantism.Graves' disease.acromegaly.pituitary dwarfism.Clear my selection

Question at position 6 The most abundant supporting cells in the central nervous system are called Question Blank 1 of 1[input].

Question at position 5 In the eye, the lens functions tofocus light on the retina at the back of the eye.protect the surface of the eye.increase vision in low-light conditions.move the eye side to side.Clear my selection

Question at position 4 Olfactory (odor) receptors are chemoreceptors. TrueFalse

If the pKa of HCHO2 is 3.74 and the pH of an HCHO2/NaCHO2 solution is 3.00, which of the following is TRUE?

更多留学生实用工具

智能学习助手

风格化写作助手

论文查重助手

文献引用助手

课堂转译助手

课堂笔记助手

Quiz搜索助手

学校历年真题

智能刷题助手

智能匹配练习

希望你的学习变得更简单