Notice: My personal stance on AI generated artwork. Retweet and share if you agree. Let us discuss, and not immediately scream bloody murder.

Now Viewing: API and the ToS: is batch downloading against ToS?
Keep it civil, do not flame or bait other users. If you notice anything illegal or inappropriate being discussed, contact an administrator or moderator.

kaitoukitsune - Group: Member - Total Posts: 2
user_avatar
API and the ToS: is batch downloading against ToS?
Posted on: 09/02/19 12:56AM

The question is in the title: If I was to use the API to make a request for downloading the results of a query would that be a breach of this line in the ToS?
- You will not use any automated process to retrieve or index any portion of the site or site contents, with the exception of public search engines.

And if so, is it possible to apply for a exception? I'm assuming it is a breach and didn't want to be a dick and just start parsing things willy nilly.



jedi1357 - Group: Moderator - Total Posts: 5768
user_avatar
Posted on: 09/02/19 12:14PM

Lozer has already allowed small batch downloading of our site content for end users. Just don't go crazy with it.

The main thing we wanted to stop were other servers scraping our site for profit or killing our bandwidth. Only public search engines are allowed to do that.




ihato - Group: Member - Total Posts: 116
user_avatar
Posted on: 09/02/19 12:16PM

I don't speak for the site, but I consider that it would be fine only if you play fair and take care not to lag the site for everybody. This means requesting, say, only one image per a respectable amount of 2 seconds or something.

This was discussed a relatively short time ago in this thread and it was decided that downloaders are OK but "don't overdo it (jedi1357)"
gelbooru.com/index.php?page=forum&s=view&id=4163

Just don't make multi-threaded HTTP requests with no delay that would download thousands of images in under a minute. Use your common sense and imagine what you would allow if you were a webmaster and just do that.




jedi1357 - Group: Moderator - Total Posts: 5768
user_avatar
Posted on: 09/02/19 12:22PM

We are actually pretty strong in this regard. He could max it at 15 simultaneous downloads and have 100 posts per request and this site wouldn't even flinch. Any more than that and I'm not sure.



kaitoukitsune - Group: Member - Total Posts: 2
user_avatar
Posted on: 09/02/19 12:45PM

Sweet my dude! I'm doing any mutli-threading as fo yet, but I was planning something of maybe 4-5 concurrent just to make sure everyone stayed sane. Thanks for the reply!



add_replyAdd Reply


1