There has been some recent discussion at Reddit of an attempt I made to turn some data from arXiv.0rg into a visualization of the relationships between research areas in mathematics. I was never completely pleased with the dataset.
When searching for papers, one gets this result:
Your query resulted in too many hits, only 1000 hits are being displayed. These are not necessarily the 1000 most recent papers. We recommend that you try a more specific search.
This limitation on the number of results makes it difficult to get more data. I wrote the arXiv.0rg a few times (I am sure they are quite busy) to request access to more data but I was never able to get a reply.
If anybody has an ideas for other databases, I would be glad to hear about it.
I posted this on my facebook page, where many of my 725 friends have a Math, Science, or Computer background. I’ll pass on to you any useful comments that I get.
– Professor Jonathan Vos Post
my 6 arXiv papers are listed at
http://arxiv.org/find/all/1/all:+AND+post+AND+jonathan+vos/0/1/0/all/0/1