Linear Regression Models

AP Statistics· 12 min read

1. The Theoretical Population Linear Regression Model★★☆☆☆⏱ 3 min

Unlike the sample least-squares regression line you calculate from observed data, the population linear regression model describes the true underlying relationship for all cases in your target population. It explicitly accounts for random variation between individual observations and the mean trend line.

y = \beta_0 + \beta_1 x + \epsilon

📘 Definition

Error Term

\epsilon

The random deviation of an individual observed y value from the mean y at a given x, assumed to be independent and normally distributed around 0.

Example:

A student who studies 4 hours scores 7 points higher than the mean score for all students who study 4 hours.

📐 Worked Example

A researcher models the population relationship between hours studied (x) and exam score (y) for all 12th graders in a state, with true parameters (\beta_0 = 32), (\beta_1 = 4.2). What is the model's predicted mean score for a student who studies 5 hours?

1
Substitute the known population parameters and x=5 into the population regression equation
2
$\text{Mean } y = 32 + (4.2 \times 5)$
3
Simplify to get the mean exam score = 53

2. Key Parameter Interpretation in Context★★★☆☆⏱ 3 min

Every parameter in the linear regression model has a specific contextual interpretation that AP graders award points for explicitly stating, with no vague phrasing allowed.

True intercept (\beta_0): The mean value of the response variable y when the explanatory variable x equals 0, only interpretable if x=0 is a plausible value in your dataset.
True slope (\beta_1): The predicted change in the mean of y for every 1-unit increase in the explanatory variable x.
Residual standard deviation (\sigma): The typical distance an observed y value falls from the population regression line, in the same units as the response variable.

📐 Worked Example

For the population model relating monthly advertising spend (x, in thousands of dollars) to monthly sales (y, in thousands of dollars), (\beta_1 = 2.7). Interpret this parameter in context.

1
Identify the 1-unit increase in x: 1 thousand dollar increase in monthly advertising spend
2
Identify the corresponding change in mean y: 2.7 thousand dollar increase in mean monthly sales
3
Combine into full contextual statement: For every additional $1000 spent on advertising, the mean monthly sales increase by $2700, on average.

3. Inference Conditions for Linear Regression Models★★★★☆⏱ 3 min

All inference procedures for linear regression (confidence intervals, significance tests for slope) require four core conditions to be met before results can be generalized to the full population.

Linear: The true relationship between x and the mean of y is linear, verified via a scatterplot of x vs y showing no obvious curved pattern.
Independent: Individual observations are independent of each other, verified via random sampling or random assignment, and 10% condition if sampling without replacement.
Normal: Residuals are approximately normally distributed at every x value, verified via a normal probability plot or histogram of residuals with no strong skew.
Equal Variance: The spread of residuals is roughly consistent across all x values, verified via a residual plot with no fan-shaped pattern.

📐 Worked Example

A student creates a residual plot for their regression of tree age vs trunk diameter, and notices the spread of residuals gets much larger as x increases. Which condition is violated, and what is the impact on inference?

1
Match the pattern to the LINE conditions: Increasing spread violates the Equal Variance condition
2
State the impact: Standard error calculations for the slope will be inaccurate, leading to misleading confidence interval widths and p-values.

✓ Quick check

Test your understanding of regression conditions:

Which plot is most appropriate to verify the Linear condition for regression?
- Scatterplot of x vs y
- Histogram of residuals
- Residuals vs x plot
- Normal probability plot
Reveal answer
Scatterplot of x vs y —
A scatterplot of the original variables lets you confirm no curved non-linear pattern exists.

4. Unbiased Point Estimates for Regression Parameters★★★☆☆⏱ 3 min

We use sample data to calculate unbiased point estimates for the unknown population parameters of the linear regression model, which form the basis for all subsequent inference procedures.

\hat{\beta_1} = r \frac{s_y}{s_x}, \quad \hat{\beta_0} = \bar{y} - \hat{\beta_1} \bar{x}

📘 Definition

Estimated Residual Standard Deviation

s

The unbiased sample estimate of the population residual standard deviation (\sigma), calculated using degrees of freedom n-2 to account for the two estimated regression parameters.

📐 Worked Example

For a sample of n=20 observations, r=0.72, (s_y=8.1), (s_x=2.3), (\bar{y}=45), (\bar{x}=12). Calculate the estimated slope and intercept.

1
$\text{Estimated slope: } \hat{\beta_1} = 0.72 \times (8.1 / 2.3) \approx 2.53$
2
$\text{Estimated intercept: } \hat{\beta_0} = 45 - (2.53 \times 12) \approx 14.64$
3
Confirm the resulting sample line passes through the point of averages ((\bar{x}, \bar{y})).

5. Common Pitfalls

Wrong move:

Interpreting the population slope as the change in individual y instead of the mean of y

Why:

This is an automatic 1-point deduction on AP free response questions

Correct move:

Explicitly include the phrase 'mean of the response variable' in every slope interpretation.

Wrong move:

Trying to interpret the intercept when x=0 is outside the range of observed x values

Why:

The intercept has no real-world meaning in this case, it is just a mathematical anchor for the line

Correct move:

State that the intercept is not interpretable in context if x=0 is not a plausible value for your dataset.

Wrong move:

Checking the Equal Variance condition on a scatterplot of x vs y instead of the residual plot

Why:

It is very hard to spot unequal variance on the original scatterplot

Correct move:

Always use the residuals vs fitted values plot to assess for fan-shaped unequal spread.

Wrong move:

Using n-1 degrees of freedom for regression inference instead of n-2

Why:

You lose two degrees of freedom when estimating the two parameters (\beta_0) and (\beta_1)

Correct move:

Use df = n-2 for all t-procedures for the true slope.

Wrong move:

Confusing s (residual standard deviation) with (s_y) (standard deviation of the response variable)

Why:

s is always smaller than (s_y) if there is a non-zero correlation between x and y

Correct move:

Explicitly reference that s describes deviation from the regression line, not overall variation in y.

6. Quick Reference Cheatsheet

Parameter	Population Symbol	Sample Estimate	Degrees of Freedom
Y-intercept	(\beta_0)	(\hat{\beta_0} = \bar{y} - \hat{\beta_1}\bar{x})	n-2
Slope	(\beta_1)	(\hat{\beta_1} = r \frac{s_y}{s_x})	n-2
Residual SD	(\sigma)	(s = \sqrt{\frac{SSE}{n-2}})	n-2

When this came up on past exams

AI-estimated based on syllabus patterns — cross-check with official past papers for accuracy. Use only as revision-focus signals.

2025 · Paper 1
Slope inference for car weight vs MPG
2024 · Paper 2
Residual condition check for house price vs size
2023 · Paper 1
Full regression model significance test

What's Next

Now that you have mastered the core structure and assumptions of the population linear regression model, you are ready to move to formal inference procedures for the true slope, including constructing confidence intervals and running hypothesis tests to assess if a linear relationship exists in the population. These skills make up roughly 15-20% of the AP Statistics free response section, so consistent practice interpreting parameters and checking conditions will drastically boost your exam score. You can also review residual analysis and transform non-linear relationships to meet the LINE conditions for valid inference.