patternMinor
What is usually the next step after showing the VC dimension?
Viewed 0 times
aftertheshowingwhatdimensionusuallynextstep
Problem
I am new to statistical learning. I have a structure $X$ where I showed its hypothesis class $H$ has VC dimension $d$. All I know now is that I can bound the number of examples by $m\geq \frac{1}{\epsilon}ln \frac{d}{\delta}$ and with probability at least $1-\delta$ I will get a hypothesis with error at most $\epsilon$.
My question concerns what is usually the next step(s),with regard to the big picture of learning a structure $X$, after showing its VCD?
I thought about studying other complexity measures for $X$ but wish to hear others suggestions.
My question concerns what is usually the next step(s),with regard to the big picture of learning a structure $X$, after showing its VCD?
I thought about studying other complexity measures for $X$ but wish to hear others suggestions.
Solution
A distinction should be made between constructing practical machine learning algorithms and theoretical algorithms, such as PAC learning algorithms. A machine learning practitioner doesn't usually invoke the concept of VC dimension — indeed, many of them probably have never heard of it, especially if they're applying machine learning in some other subject. While VC dimension might be useful in coming up with algorithms (as in the case of SVMs), it appears to have no practical import.
When constructing theoretical algorithms such as learning algorithms under the PAC model, the story could be different, but unfortunately I don't know too much about that. From the little I've seen, VC dimension doesn't get mentioned even there. In fact, it seems that VC dimension is mentioned mostly in literature attempting to relate it to other parameters.
When constructing theoretical algorithms such as learning algorithms under the PAC model, the story could be different, but unfortunately I don't know too much about that. From the little I've seen, VC dimension doesn't get mentioned even there. In fact, it seems that VC dimension is mentioned mostly in literature attempting to relate it to other parameters.
Context
StackExchange Computer Science Q#19887, answer score: 6
Revisions (0)
No revisions yet.