Блог пользователя thekushalghosh

Ways for Fast Input / Output in Python
Автор thekushalghosh, 4 года назад, По-английски

Hello CodeForces Community,

Input / Output in Python can be sometimes time taking in cases when the input is huge or we have to output many number of lines, or a huge number of arrays(lists) line after line.

I have come across many questions on CodeForces where the style of taking input and printing makes your code quite faster.

For Input :-

Normally, the input is taken from STDIN in the form of String using input(). And this STDIN is provided in the Judge's file. So why not try reading the input directly from the Judge's file using the Operating system(os) module, and input / output(io) module. This reading can be done in the form of bytes.

The code for that would be :-

import io,os
input = io.BytesIO(os.read(0,os.fstat(0).st_size)).readline

or a native method (which can be used for not too large inputs) :-

import sys
input = sys.stdin.readline

Now for Output :-

Instead of throwing the output to the STDOUT, we can try writing to the Judge's sytem file. The code for that would be to use sys.stdout.write instead of print. But remember you can only output strings using this, so convert the output to string using str or map.

Examples :-

For printing an integer, instead of

print(n)

Use :-

sys.stdout.write(str(n) + "\n")

For printing a list of integers, instead of

print(*list)

Use :-

sys.stdout.write(" ".join(map(str,list)) + "\n")

Now Program examples On CodeForces, where this was useful :-

Question 1
TLE Solution
AC Solution

Question 2
Earlier Solution
Faster Solution

  • Проголосовать: нравится
  • +19
  • Проголосовать: не нравится

»
4 года назад, # |
← Rev. 2   Проголосовать: нравится +6 Проголосовать: не нравится

I want to add something. When using BytesIO method of input, reading strings does not work normally like the STDIN method. Rather it returns a bytecoded string (I say bytecoded string, I am not sure what it's really called).

Suppose you input a string somestring as follows, and then print it

s=input()
print(s)

It will print b'somestring' ,rather than somestring. If you want to print somestring you will have to decode the bytecoded string, and do something like this:

s=input().decode()
print(s)

So, the overall code will be:

import io,os
input = io.BytesIO(os.read(0,os.fstat(0).st_size)).readline
s=input().decode()
print(s)

Remember this only happens in the case of strings. Integers behave normally.

→ Ответить
»
4 года назад, # |
  Проголосовать: нравится 0 Проголосовать: не нравится

Thanks a lot! I was getting TLE of 2 sec problem. After implementing this i made it in 1091 ms. It is very very helpful when you have to take input or give output in a loop/several times.

→ Ответить
»
3 года назад, # |
  Проголосовать: нравится 0 Проголосовать: не нравится

I used input = io.BytesIO(os.read(0,os.fstat(0).st_size)).readline and it just returns empty string without waiting for input.

What am I doing wrong?

→ Ответить
  • »
    »
    3 года назад, # ^ |
      Проголосовать: нравится 0 Проголосовать: не нравится

    whole code please?

    → Ответить
    • »
      »
      »
      3 года назад, # ^ |
        Проголосовать: нравится 0 Проголосовать: не нравится

      Using it in shell for example:

      >>> import os, io
>>> input = io.BytesIO(os.read(0,os.fstat(0).st_size)).readline
>>> input()
b''
>>>
      → Ответить
      • »
        »
        »
        »
        3 года назад, # ^ |
          Проголосовать: нравится 0 Проголосовать: не нравится

        Looks like this code needs to read input from I/O redirection. Use it like:

        # test.py
import os, io
input = io.BytesIO(os.read(0, os.fstat(0).st_size)).readline

s = input().decode().rstrip("\r\n")
print(s)

        and $ python3 test.py < input.txt

        → Ответить
        • »
          »
          »
          »
          »
          3 года назад, # ^ |
            Проголосовать: нравится -10 Проголосовать: не нравится

          Thanks.

          And, do you know why 147370723 didn't work? The previous submission (147342596) got TL, and I just used this method of input for list "a" in the next one.

          → Ответить
          • »
            »
            »
            »
            »
            »
            3 года назад, # ^ |
              Проголосовать: нравится 0 Проголосовать: не нравится

            I just modified your solution and tested a bit, it can be TLE again (no runtime error) but still not passing the tests.

            You can refer to 147473106 which is what I got after modifying your implementation. I use set instead of list to indicate whether a row/col is colored or not.

            → Ответить
            • »
              »
              »
              »
              »
              »
              »
              3 года назад, # ^ |
                Проголосовать: нравится 0 Проголосовать: не нравится

              I took a look at your solution and updated mine (147482726); yours got AC and mine TL again. (I wonder why)

              But finally I could use this method of input. As it seems, it should not be mixed with other methods.

              And the big question for me is that why io.BytesIO(os.read(0, os.fstat(0).st_size)).readline cant be used in place of the input variable it is assigned to. (it would return empty string)

              → Ответить
              • »
                »
                »
                »
                »
                »
                »
                »
                3 года назад, # ^ |
                  Проголосовать: нравится 0 Проголосовать: не нравится

                i am getting an error while using this line of code:

                input = io.BytesIO(os.read(0,os.fstat(0).st_size)).readline

                → Ответить
»
3 года назад, # |
  Проголосовать: нравится 0 Проголосовать: не нравится

Which language is the best for competitive programming.

→ Ответить
  • »
    »
    3 года назад, # ^ |
      Проголосовать: нравится +6 Проголосовать: не нравится

    Well, each language has strength and weakness.

    Python is very convenient, but the speed is very slow and you will easily get TLE. C++ is mainstream language and very fast, but it is easy to fail system test, like forget long long int and some variable numbers may exceed 2147483647.

    Java, go, swift also have pro and cons.

    The best strategy is that you should master more than one language, one fast and one slow, like c++ and python. For loose constraint problem, use python to save time, and for tight constraint problem, use C++ to get passed.

    → Ответить
»
2 года назад, # |
  Проголосовать: нравится 0 Проголосовать: не нравится

Hey! I have used above methods but they do not work for me , even if they are working on my local machine .Please check these submissions 164067953 and 164066429 and help me to recitify the mistakes. Thank you

→ Ответить
»
10 месяцев назад, # |
  Проголосовать: нравится 0 Проголосовать: не нравится

It's been 3 years since this was posted.

I'd say newer Python versions work well with print(' '.join(map(str, A))) and open(0).read().split().

n, k, *x = [*map(int, open(0).read().split())]
# if x should be a list of tuples
c = [(a,b,c) for a,b,c in zip(*[iter(x)]*3)]

The io.BytesIO approach might be better for string based inputs (to not have utf8 on by default). I couldn't measure the difference at all with sys.stdout.write or io.BytesIO on int inputs.

The general idea is to read the whole input once and process it in memory (as is the case in the longer example above). Similarly, calling print once is as fast as calling sys.stdout.write. print(*A) is slower than print(' '.join(map(str, A))).

→ Ответить