Post Reply Anyway to export history?
9021 cr points
Send Message: Send PM GB Post
Offline
Posted 5/11/17
Just wondering if there's anyway I can get an export of the series, episode, and maybe an access_date field of my own history? I'm a data nut and I'd love to drop it into a personal database and run some analytics on my own data.
7768 cr points
Send Message: Send PM GB Post
25 / M / Netherlands
Offline
Posted 5/11/17

swvanlinge9 wrote:

Just wondering if there's anyway I can get an export of the series, episode, and maybe an access_date field of my own history? I'm a data nut and I'd love to drop it into a personal database and run some analytics on my own data.


I am pretty sure this data isn't publicly available. To go even further, I am pretty sure Chrunchyroll doesn't have a solid overview of it.
9021 cr points
Send Message: Send PM GB Post
Offline
Posted 5/11/17
If it wasn't all lazy-loaded it might be easy to write a scraper...

Does CR respond on these forums? I'd pay a couple bucks just for the data I requested and I know it wouldn't take their database people more than a couple minute to generate a csv and send it >.>
One Punch Mod
98427 cr points
Send Message: Send PM GB Post
F / Boston-ish
Offline
Posted 5/11/17 , edited 5/11/17

swvanlinge9 wrote:

If it wasn't all lazy-loaded it might be easy to write a scraper...

Does CR respond on these forums? I'd pay a couple bucks just for the data I requested and I know it wouldn't take their database people more than a couple minute to generate a csv and send it >.>


The forums are primarily for user to user communication, and are not routinely read by CR staff.

Occasionally CR staff do respond to threads in the "Help" section of the forums, so I've moved this thread to the Site Support / Minor Questions forum there.

However, I doubt very much they'd assign one of their "database people" to pull this info just for your personally, and I wouldn't hold my breath for this to become a feature.
155 cr points
Send Message: Send PM GB Post
22 / M / United States
Offline
Posted 5/11/17
Why would you even want to get that info? What's the point? And if you're a "data nut" then why didn't you start documenting this yourself? There's websites for these things such as myanimelist.

Also I agree with lorreen I doubt that they will make this an available feature let alone just give you the info to you alone. I suggest to start documenting things from here on if you really want analytical data of yourself.
9021 cr points
Send Message: Send PM GB Post
Offline
Posted 5/11/17 , edited 5/11/17
I want to see how many episodes I've watched over specific periods of time for example. I want to get an accurate count of the hours I've spent in anime as well as be able to sort anime I've watched alphabetical, maybe add some of my own tags to it. I need more control over it than myanimelist gives you to do what I want. It's a good suggestion though.

As to "why didn't I document this myself", well obviously because it's being stored in a database somewhere automatically, so what's the point of going through the effort of documenting all this myself? It exists somewhere so theoretically it should be possible to get at it. Does crunchyroll have an API that can access history?

EDIT: Looks like there are ways of hitting their API: https://github.com/aheadley/python-crunchyroll

I'm wondering why this isn't a feature though... Every web dev job I've had we've built csv export tools in history pages because it's such a common request.

And thanks for moving this to the help forum!
9021 cr points
Send Message: Send PM GB Post
Offline
Posted 5/11/17
EDIT: via the python package above, I have been able to get a dump of my queue, no luck on history just yet.
Otter Modder
51191 cr points
Send Message: Send PM GB Post
24 / M / Florida
Offline
Posted 5/11/17 , edited 5/12/17
It doesn't look like CR serves the watch date, just the order they were watched in. Also I don't think it allows duplicates, so if you watch the same episode more than once it just keeps the most recent time. You can grab the list of your history (in html form unfortunately) here: http://www.crunchyroll.com/home/history/ajax_page?page=0&items_per_page=99999999999
9021 cr points
Send Message: Send PM GB Post
Offline
Posted 5/11/17
Love it, thanks! I can save off the html and do some text parsing.
9021 cr points
Send Message: Send PM GB Post
Offline
Posted 5/11/17 , edited 5/11/17
Actually, it looks like any items_per_page value exceeding 1512 doesn't show any more values. I have a lot more history than that. Also, if I do 1512 and try to increment the page, it only moves the start position. I'm trying to find out by how much.

EDIT: Looks like I can do them in batches of 500, so this is still the best solution so far.

Thanks!

EDIT EDIT: Looks like it might go past that, I must have cleared my history around 1512 episodes ago or something.
You must be logged in to post.