Display word frequency data
One of the big challenges for self guided learning is answering the question, "Is this information important to learn?" So as I am learning Pali I am constantly asking, "How common is this word in the canon?" If it seems to only appear a few times, I may not bother to learn it. But if it is common, then I can know it's worth committing to memory, or doing further investigation. The way I usually go about answering the question is by doing a search. Although the DPR makes this sort of work possible, I wonder if it couldn't be automated in some way.
I realize the nature of Pali is such that with compounds and different word forms it may be hard to define frequency. And that frequency does not necessarily equal importance. But I imagine even a crude approach might have benefits. I think it makes the most sense for the frequency data to be included in a file rather than generated on the fly.
Perhaps some of the scripts on this site might be useful for generating the data:http://nibbanam.com/pali_language_tools.html#freqList
There is also the question of which texts the frequency data would be collected from. Personally, I'm interested in learning Sutta Pali, so I would only want data from the first four Nikayas and the sutta-type parts of the KN. I don't think this is such an arbitrary distinction, and perhaps it would be possible to have both sets of data available (that is, sutta Pali vs. entire tipitaka with commy)
Rather than having the actual frequency rank, perhaps words could just be rated as very common, common, rare, very rare. This might make it clear that it is only giving a general sense.
