non-differentiable likelihood functions

Mar 08, 2010 14:08

Are likelihood functions ever non-differentiable?

Of course, you can always transform the parameters in such a way that you get a kink in the function... My question is whether this ever occurs naturally.

---

UPDATE: clearly, if the likelihood for each data point is differentiable, then so is the likelihood for the whole data.

stats

Leave a comment

Comments 9

bhudson March 9 2010, 00:17:40 UTC
No delta functions?

Reply

gustavolacerda March 9 2010, 00:22:59 UTC
Likelihoods can't be infinite. In particular, they can't exceed 1.

Reply

stepleton March 9 2010, 15:12:33 UTC
I'm not sure what you mean here, but I think it may be due to some imprecision in the term "likelihood". For a continuous distribution, you would use the PDF as the likelihood function in most settings---so, for example, if you were considering 1-D normal distributions with stddev fixed to something small, the likelihood function for the mean parameter f(x | µ), given some single datum x, could indeed exceed 1.

Also, what does "naturally" mean in the original question?

Reply

stepleton March 9 2010, 15:20:33 UTC
PS: The "imprecision" here is not on your part, but on the part of users of the word all over.

Reply


Leave a comment

Up