1. How is Data Science Different from Traditional Data Analysis?
Ans:
Data science focuses on extracting actionable insights from vast and complex datasets using advanced tools like Python, machine learning, and statistical methods. Traditional data analysis primarily involves reviewing historical data and generating basic summaries or reports, whereas data science emphasizes predicting future trends and solving intricate problems through algorithms and coding.
2. How does supervised learning differ from unsupervised learning?
Ans:
In supervised learning, models are trained on datasets with known inputs and corresponding outputs, similar to receiving guidance from a teacher. Unsupervised learning deals with data without labels, where the algorithm aims to uncover hidden structures or clusters, like identifying groups of people sharing interests without prior information.
3. What is overfitting in machine learning, and how can you prevent it?
Ans:
Overfitting occurs when a model learns the training data too precisely, including noise and errors, leading to poor generalization on new data. Common ways to avoid overfitting include using cross-validation, simplifying the model, and applying regularization techniques.
4. Explain the bias-variance tradeoff.
Ans:
Bias is error from making wrong assumptions; variance is error from being too sensitive to small changes in data. A good model balances both too much bias leads to underfitting, while too much variance leads to overfitting.
5. What Are the Key Differences Between Python and R in Data Science?
Ans:
Python is widely favored for building data applications and machine learning models due to its flexibility and broad adoption in industry. R is specialized for statistical analysis and advanced data visualization, making it popular in research and academic settings.
6. How do you handle missing data in a dataset?
Ans:
Missing data can be managed by removing incomplete records, imputing missing values using means or modes, or employing advanced techniques such as interpolation or predictive modeling to estimate the missing entries.
7. Explain the concept of feature engineering.
Ans:
Feature engineering means creating new input variables (features) from existing data to help the model learn better. It involves cleaning data, transforming values, and combining features to improve prediction accuracy.
8. What is the difference between a classification and a regression problem?
Ans:
In classification, you predict categories like “spam” or “not spam.” In regression, you predict continuous values like a house price or temperature. Both are types of supervised learning but solve different problems.
9. What is a confusion matrix in classification?
Ans:
A confusion matrix shows how well a classification model performs by comparing actual values with predicted ones. It breaks results into categories like true positives, false positives, true negatives, and false negatives.
10. What are precision and recall?
Ans:
Precision tells you how many of the predicted positives are actually correct. Recall indicates how many of the real benefits were correctly predicted. They help measure how well a model finds the right results.
11. What is cross-validation, and why is it important?
Ans:
Cross-validation tests a model’s accuracy by dividing data into parts, training on some, and testing on others. It helps make sure the model performs well on unseen data and avoids overfitting.
12. What is regularization used for in machine learning?
Ans:
Regularization reduces overfitting by adding a penalty to complex models. It helps keep the model simple and improves performance on new, unseen data.
13. What is a decision tree, and how does it work?
Ans:
A decision tree is a predictive model that splits data based on feature values through a series of decision rules arranged like a flowchart, ultimately leading to classification or regression outputs at its leaves.
14. What are the differences between bagging and boosting?
Ans:
Bagging builds multiple models independently and combines them to improve accuracy. Boosting builds models one after another, each one learning from the mistakes of the previous one to improve performance.
15. What is dimensionality reduction, and why is it important?
Ans:
Dimensionality reduction involves reducing the number of input variables while retaining essential information, which speeds up training, reduces noise, and improves model performance, especially in high-dimensional datasets.
