kobe24's blog

Illegal to Parse a contest ?
By kobe24, 9 years ago, In English

Recently i got bored at competitive programming and i thought of learning new things .

Since i use codeforces parser extensively and fascinated by things people build using Web Scraping i started to learn how to build a parser During this i learnt about robots.txt file and saw codeforces robot.txt in which i saw this line Disallow: /contest/ but the parser that i use extensively parses contest and extracts the sample test cases , also there is no api to extract present contest problems/test cases.

So is it illegal to parse a contest ? Correct me if i am wrong

  • Vote: I like it
  • +9
  • Vote: I do not like it

»
9 years ago, # |
  Vote: I like it +10 Vote: I do not like it

I think it is legal. Robot.txt is for search engines. Just don't do more than 5 queries per second.

→ Reply
  • »
    »
    9 years ago, # ^ |
      Vote: I like it 0 Vote: I do not like it

    Yeah it might be a generalised file not intended for us , also this is the most detailed one i saw and this is the most funniest one

    → Reply
»
9 years ago, # |
  Vote: I like it -8 Vote: I do not like it

You can do that with API, that is designed for program to access the website. (And all of them are under /api/, which is not in the list of robot.txt)

→ Reply
  • »
    »
    9 years ago, # ^ |
      Vote: I like it +12 Vote: I do not like it

    how do I parse a contest using api?

    → Reply
  • »
    »
    9 years ago, # ^ |
      Vote: I like it 0 Vote: I do not like it

    problems in a contest are not included in api , at least for test cases we cannot do it with api

    → Reply