How to pass the date parameter in pyspark query using Jupyter notebook?

Question

I want to pass the date parameter in below query in jupyter notebook but its not working as the way its mentioned below. Dont know where the problem is lying.

filedate = '2022-11-15'

query = """(select * from db.xyz
        where name = 'Tom'
        and login = '{filedate}') as salary"""

 df = spark.read.format("jdbc")
                          .option("url", jdbc_url)
                          .option("driver",jdbc_driver)
                          .option("dbtable" ,query).load()

Asked By: Rahul

||

Source

Answer 1

You are missing an f-string:

filedate = '2022-11-15'

query = f"""(select * from db.xyz
        where name = 'Tom'
        and login = '{filedate}') as salary"""

Answered By: ms12

How to pass the date parameter in pyspark query using Jupyter notebook?

Question:

Answers: