Inexpensive ways to add seek to a filetype object


PdfFileReader reads the content from a pdf file to create an object.

I am querying the pdf from a cdn via urllib.urlopen(), this provides me a file like object, which has no seek. PdfFileReader, however uses seek.

What is the simple way to create a PdfFileReader object from a pdf downloaded via url.

Now, what can I do to avoid writing to disk and reading it again via file().

Thanks in advance.

Asked By: lprsd



You could use the .read() method to read in the entire data of the file, and then create your own File-like object (most likely via StringIO) to provide access to it.

Answered By: Amber

There isn’t really an inexpensive, ready-to-use way to do this. The simplest way is to read all data and put it into a StringIO object. That does, however, require you read everything first, which may or may not be what you want.

If you want something that only reads as necessary, and then stores what was read (or perhaps just a portion of what was read) then you will have to write it yourself. You may want to see the source for the StringIO module (or the io module, in Python 2.6) for some examples.

Answered By: Thomas Wouters

I suspect you may be optimising prematurely here.

Most modern systems will cache files in memory for a significant period of time before they flush them to disk, so if you write the data to a temporary file, read it back in, then close and delete the file you may find that there’s no significant disc traffic (unless it really is 100MB).

You might want to look at using tempfile.TemporaryFile() which creates a temporary file that is automatically deleted when closed, or else tempfile.SpooledTemporaryFile() which explicitly holds it all in memory until it exceeds a particular size.

Answered By: Duncan

Use io.BytesIO as shown in the docs. Slightly adapted:

from io import BytesIO
import urllib.request

import pypdf

url = ""
data = urllib.request.urlopen(url).read()

# creating a pdf reader object 
reader = pypdf.PdfReader(BytesIO(data)) 
# printing number of pages in pdf file 
# creating a page object 
page = reader.pages[0] 
# extracting text from page 
Answered By: Martin Thoma
Categories: questions Tags: , , , ,
Answers are sorted by their score. The answer accepted by the question owner as the best is marked with
at the top-right corner.