Can SQLAlchemy be configured to be non-blocking?
Question:
I’m under the impression that database calls through SQLAlchemy will block and aren’t suitable for use in anything other than synchronous code. Am I correct (I hope I’m not!) or is there a way to configure it to be non-blocking?
Answers:
Have a look at Tornado as they’ve got some neat non-blocking libraries, particularly tornado.gen.
We use that along with Momoko, a non-blocking psycopg wrapper lib for Tornado. It’s been great so far. Perhaps the only drawback is you lose all the model object stuff that SQLAlchemy gives you. Performance is unreal though.
You can use SQLA in a non-blocking style using gevent. Here’s an example using psycopg2, using psycopg2’s coroutine support:
https://bitbucket.org/zzzeek/green_sqla/
I’ve also heard folks use the same idea with pymysql. As pymysql is in pure Python and uses the sockets library, gevent patches the socket library to be asynchronous.
Without the help of greenlet, the answer is no, in the context of asyncio.
However it is possible to use only a part of SQLAlchemy in asyncio. Please find example in the GINO project, where we used only SQLAlchemy core without engine and full execution context to make a simple ORM in asyncio.
I’m under the impression that database calls through SQLAlchemy will block and aren’t suitable for use in anything other than synchronous code. Am I correct (I hope I’m not!) or is there a way to configure it to be non-blocking?
Have a look at Tornado as they’ve got some neat non-blocking libraries, particularly tornado.gen.
We use that along with Momoko, a non-blocking psycopg wrapper lib for Tornado. It’s been great so far. Perhaps the only drawback is you lose all the model object stuff that SQLAlchemy gives you. Performance is unreal though.
You can use SQLA in a non-blocking style using gevent. Here’s an example using psycopg2, using psycopg2’s coroutine support:
https://bitbucket.org/zzzeek/green_sqla/
I’ve also heard folks use the same idea with pymysql. As pymysql is in pure Python and uses the sockets library, gevent patches the socket library to be asynchronous.
Without the help of greenlet, the answer is no, in the context of asyncio.
However it is possible to use only a part of SQLAlchemy in asyncio. Please find example in the GINO project, where we used only SQLAlchemy core without engine and full execution context to make a simple ORM in asyncio.