ChaosAngel's blog

Redundant testing on duplicate hacks
By ChaosAngel, 5 years ago, In English

Hello! In the aftermath of the recent educational round, there is an apparent weakness in the test-cases of problem A that is leading to a ton of hacks.

This large volume of hacks will be added to the systests tomorrow morning. However, they do not represent distinct weaknesses; odds are that only a tiny fraction of these test-cases is necessary, since they are all targeting the same weakness, and most codes will fail at the first hack.

Doesn't this represent an inefficiency that will be an added burden on the already crowded system tests? I don't know how this could be handled, but perhaps live rejudging of all codes on individual successful hack cases will prevent many unnecessary hacks from being created in the first place? This is not exclusive to this contest, and is a persistent issue in div3's and educationals with long hacking phases that could perhaps be improved to save system test resources.

Cheers
CA

  • Vote: I like it
  • +51
  • Vote: I do not like it

»
5 years ago, # |
  Vote: I like it 0 Vote: I do not like it

This is exactly what I was afraid of :P

→ Reply
  • »
    »
    5 years ago, # ^ |
    ← Rev. 2   Vote: I like it +7 Vote: I do not like it

    According to the official telegram channel , the problems in codeforces today were due to power outrage , not due to many duplicate hacks.

    → Reply
    • »
      »
      »
      5 years ago, # ^ |
        Vote: I like it +3 Vote: I do not like it

      Thanks for the clarification. I thought that the 100+ cases for A drowned the system given we had 20,000 participants :D

      → Reply