Feature Importance & Model Explainability Quiz — Questions & Answers

Explore essential concepts of feature importance and model explainability with this quiz designed to reinforce your understanding of interpretable machine learning, feature evaluation, and the significance of transparent AI models. Perfect for those looking to grasp the basics of explaining model predictions and identifying influential features in data-driven solutions.

This quiz contains 10 questions. Below is a complete reference of all questions, answer choices, and correct answers. You can use this section to review after taking the interactive quiz above.

1. Question 1: Understanding Feature Importance

   Which term best describes how much a feature contributes to a model's prediction, such as feature X having greater influence than feature Y in classifying images?

   • Feature Importance
   • Feature Scaling
   • Feature Coding
   • Feature Extraction
   Show correct answer

   Correct answer: Feature Importance

   Explanation: Feature importance quantifies the contribution of each feature to a model’s predictions, making it central to model explainability. Feature scaling refers to adjusting the range of features, not their influence. Feature extraction is about creating new features from existing ones, and feature coding relates to representing categories numerically. Only 'feature importance' measures relative influence on outcomes.

2. Question 2: Types of Model Explainability

   Which term describes the process of understanding how a machine learning model arrives at its decisions using techniques like decision trees or partial dependence plots?

   • Cross-Validation
   • Overfitting
   • Data Augmentation
   • Model Explainability
   Show correct answer

   Correct answer: Model Explainability

   Explanation: Model explainability refers to methods used to interpret and understand how models make predictions. Data augmentation is used to expand training data, which does not explain decisions. Overfitting is a modeling problem where a model learns noise instead of signal, unrelated to explainability. Cross-validation assesses model performance, not interpretability.

3. Question 3: Global vs. Local Interpretability

   In the context of explainability, what does 'global interpretability' refer to when analyzing a model’s behavior?

   • Transforming variables
   • Improving computational speed
   • Understanding the overall behavior of a model across all predictions
   • Explaining individual predictions
   Show correct answer

   Correct answer: Understanding the overall behavior of a model across all predictions

   Explanation: Global interpretability focuses on understanding model behavior across the entire dataset or all predictions, providing insights into which features generally matter most. Explaining individual predictions refers to local interpretability. Transforming variables and improving computation are unrelated to the interpretability scope.

4. Question 4: Permutation Importance Usage

   When computing permutation importance for a trained model, what is the primary action taken with each feature to evaluate its importance?

   • Doubling the values of the feature
   • Removing the feature from the training set
   • Randomly shuffling the feature values in the dataset
   • Normalizing the feature to a 0-1 scale
   Show correct answer

   Correct answer: Randomly shuffling the feature values in the dataset

   Explanation: Permutation importance involves randomly shuffling each feature and measuring the resulting decrease in model performance to assess how much the model relies on that feature. Normalizing does not determine importance. Removing the feature changes the nature of the model; doubling the values alters the scale but not the measurement of importance.

5. Question 5: Interpretable Models

   Which type of model is generally considered inherently interpretable due to its transparent decision-making process, for example, showing how age and income lead to a loan approval?

   • Decision Tree
   • Random Forest
   • K-Nearest Neighbor
   • Neural Network
   Show correct answer

   Correct answer: Decision Tree

   Explanation: Decision trees are considered interpretable because their rules and splits clearly show how decisions are made. Neural networks have complex structures making them hard to interpret. K-nearest neighbor depends on data proximity and doesn't present transparent logic. Random forests are ensembles of trees and are less interpretable than single trees due to their complexity.

6. Question 6: SHAP Values and Their Purpose

   What do SHAP values provide when explaining individual model predictions in contexts like credit scoring?

   • A random sampling of the data
   • The contribution of each feature to a specific prediction
   • The average accuracy across all features
   • The linear transformation of inputs
   Show correct answer

   Correct answer: The contribution of each feature to a specific prediction

   Explanation: SHAP values explain how much each feature contributed to an individual model prediction, making them useful for local interpretability. They do not measure average accuracy or perform transformations or random sampling. Their primary benefit lies in providing detailed feature attribution for single predictions.

7. Question 7: Why Explainability Matters

   Why is model explainability especially important in applications like medical diagnosis or loan approvals?

   • To speed up prediction time
   • To increase dataset size
   • Because decisions must be transparent and understandable
   • Because models always perform better with it
   Show correct answer

   Correct answer: Because decisions must be transparent and understandable

   Explanation: In high-stakes applications, explainability helps ensure that stakeholders can trust and understand the model’s decisions. While explainability does not guarantee better performance or faster prediction, and it does not relate to dataset size, its core value lies in transparency and accountability.

8. Question 8: Correlation vs. Causation in Feature Importance

   What is a main limitation of using feature importance to infer relationships between features and target variables, such as in predicting house prices?

   • Feature importance measures only categorical features
   • It removes outliers automatically
   • Feature importance can show correlation, not direct causation
   • Feature importance ignores numerical data
   Show correct answer

   Correct answer: Feature importance can show correlation, not direct causation

   Explanation: Feature importance typically reveals how correlated a feature is with the target, but it cannot indicate causality. It does not only measure categorical features or remove outliers. Also, feature importance can be computed for both numerical and categorical data, so the latter two options are incorrect.

9. Question 9: Partial Dependence Plots

   What do partial dependence plots help visualize in a model, such as showing the effect of 'age' on predicted insurance costs?

   • The relationship between a single feature and the predicted outcome
   • Variance across datasets
   • The raw data distribution
   • Hyperparameter values
   Show correct answer

   Correct answer: The relationship between a single feature and the predicted outcome

   Explanation: Partial dependence plots show how predicted outcomes change as one feature varies, holding other features constant. They do not display raw data distributions or hyperparameter settings. Variance across datasets is not their focus. They specifically provide insights into feature-outcome relationships.

10. Question 10: Simple Ways to Explain Linear Model Coefficients

    In a simple linear regression predicting weight from height, how can you interpret the model’s coefficient for height?

    • As the change in predicted weight for each unit increase in height
    • As the average weight in the dataset
    • As a random value assigned during training
    • As the product of height and weight
    Show correct answer

    Correct answer: As the change in predicted weight for each unit increase in height

    Explanation: A linear regression coefficient represents the change in the predicted value (weight) for each one-unit increase in the feature (height), assuming all else is constant. It is not the product of the variables, nor a random value assigned arbitrarily. The average weight is unrelated to the coefficient's interpretation.