Calculating Average Hypothesis

ripande · #1 01-31-2013, 11:36 AM

I guess this question has been asked before, but I am not very clear on it.

I understand calculating the average hypothesis of a constant i.e. taking average of the constant values of differnet hypothesis.

But what does calculating average hypothesis of a hypothesis set which consists of lines in y= mx+c mean? How is it calculated ?

ripande · #2 01-31-2013, 11:44 AM

I read the earlier post on this question once again. The concept is clear to me now

ripande · #3 02-01-2013, 11:06 AM

I wanted to validate that what I have understood is correct.

1. I calculated the value of "a" for which the which minimizes the least square for two points ( x, sin(pi*x) ), x being between -1 and 1.

2. Repeated the above for 100 times and hence got 100 values of "a"

3. Then I chose a fresh point x3 between [-1, 1] and calculated the value of y3 = a*x3 for all 100 points

4. Calculated average value of y3 for 100 points, say y_avg.

5. Calculated "a" for avg hypothesis as : y_avg/x3

Is my method of calculating avg hypothesis correct ? Iam not very confident of the answer I am getting

yaser · #4 02-01-2013, 12:11 PM

Quote:

Originally Posted by ripande

1. I calculated the value of "a" for which the which minimizes the least square for two points ( x, sin(pi*x) ), x being between -1 and 1.

2. Repeated the above for 100 times and hence got 100 values of "a"

These steps are correct (with

instead of

in step 1) in calculating the final hypothesis $g^{\cal D}$ for 100 different sets ${\cal D}$ .

Quote:

3. Then I chose a fresh point x3 between [-1, 1] and calculated the value of y3 = a*x3 for all 100 points

This step evaluates $g^{\cal D}(x_3)$ for each ${\cal D}$ in the 100 runs. If

is fixed for all 100 runs, this step can be used to evaluate the bias and variance at the point

(namely ${\bf bias}(x_3)$ and ${\bf var}(x_3)$ ).

Quote:

4. Calculated average value of y3 for 100 points, say y_avg.

If the 100 points are the same

with different $g^{\cal D}$ , then the average approximates ${\bar g}(x_3)$ . If the points are different, I am not sure about the utility of this quantity for the calculation of bias and variance.

Quote:

5. Calculated "a" for avg hypothesis as : y_avg/x3

You already have the different values of

for different data sets $g^{\cal D}$ (these are the values of

that you used to calculated

from

). Because the formula for the hypothesis is linear in

, you can directly calculate

of the average hypothesis by averaging all the

's. What you are suggesting is equivalent in this case.

ripande · #5 02-01-2013, 01:02 PM

Thanks Prof Yaser for the clarification.

So, if understand correctly,since the hypothesis is linear in "a", I can directly take the average of the value "a" in all hypothesis to calculate the average hypothesis; and what I was doing was just equivalent to it.

What should be done in a hypothetical case where the value had not been linear in the hypothesis set?

yaser · #6 02-01-2013, 01:28 PM

Quote:

Originally Posted by ripande

So, if understand correctly,since the hypothesis is linear in "a", I can directly take the average of the value "a" in all hypothesis to calculate the average hypothesis; and what I was doing was just equivalent to it.

Exactly.

Quote:

What should be done in a hypothetical case where the value had not been linear in the hypothesis set?

You average the hypothesis value $g^{\cal D}({\bf x})$ at each point ${\bf x}$ , rather than average the parameters.

Thread Tools
Show Printable Version Email this Page
Display Modes
Switch to Linear Mode Hybrid Mode Switch to Threaded Mode