[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Fwd: Explanation for Zipf's law..
- To: cse494-s07@parichaalak.eas.asu.edu
- Subject: Fwd: Explanation for Zipf's law..
- From: "Subbarao Kambhampati" <rao@asu.edu>
- Date: Fri, 16 Feb 2007 09:27:54 -0700
- Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:sender:to:subject:in-reply-to:mime-version:content-type:references:x-google-sender-auth; b=Kf4IWEN9ppwcVwyxaLt88mhk0LgedGH31Pc3brlOMdH7M7hG4p0gB6eYFiuYb9C+Qk75gBGvPt8SLnZziioJNdlt0tBdgPRGJyJKQUjIQ4Nrps+NLBWKDIEvBcTROZgrTfJPGQYUcIqrB6s2/m8n2Psoo7DgN8n9W99arcCUhzY=
- In-reply-to: <8d80847a0702160827k2120bc5avad44721215179d5@mail.gmail.com>
- References: <8d80847a0702160827k2120bc5avad44721215179d5@mail.gmail.com>
- Sender: subbarao2z2@gmail.com
I think I stated the explanation for zipf's law wrong in the class.
Specifically, Zipf's own explanation for the observed zipfian distribution of word frequency in a language is
that it is a natural tradeoff between the speaker's interest in using a *SMALL* vocabulary and the listener's interest
in hearing a *LARGE* vocabulary (so different shades of meaning can be easily disambiguated). [I think I inverted it
in the class..]
There have been alternate explanations of course. People even showed that even if we just randomly type letters with spaces,
the "emergent" language will have a zipfian distribution!
I added a slide on this to the lecture notes.
rao