a thoughtful web.
Good ideas and conversation. No ads, no tracking.   Login or Take a Tour!
comment by JakobVirgil
JakobVirgil  ·  4364 days ago  ·  link  ·    ·  parent  ·  post: A graph of hubski

can I get a copy of the data set?





rozap  ·  4364 days ago  ·  link  ·  

Yep, it's here: http://hiiamchris.com/hubski/hub_graph/edges.json

It's just two lists, one called nodes with a username and a follower count, and the other called edges, with a to and from attribute, which is just a username.

JakobVirgil  ·  4364 days ago  ·  link  ·  

is this the one that is updated?

rozap  ·  4364 days ago  ·  link  ·  

It's the same dataset that the graph visualization is drawing at the moment. So yea, that's the current one.

lelandbatey  ·  4364 days ago  ·  link  ·  

Would you be willing to release the info scraper that gathers all of the data? Or is that out of the question?

rozap  ·  4364 days ago  ·  link  ·  

I'd be willing to do that, but I know there were some issues with the hubski server getting overloaded, so I'm not sure if mk needs a bunch of crawlers running about. If he says it's ok, however, I can definitely pass on the code - though it's nothing special at all, just a python script. mk, do you have any thoughts on crawling hubski?

mk  ·  4364 days ago  ·  link  ·  

Go easy on us. :)

Why not share by request by PM?

lelandbatey  ·  4364 days ago  ·  link  ·  

I think sharing the scraper via PM is the best course of action right now.

On a side note, why isn't there SOME kind of donate link for hubski? I'd love to donate a bit to hubski!