Interpolate sql in SQLDataset in catalog.yml Question: Is there a way to interpolate a SQLDataset query in catalog.yml passing some argumentparameter. Example: person: type: pandas.SQLQueryDataSet sql: "SELECT * FROM public.people WHERE id = ${id};" credentials: db_credentials Thanks in advance! Asked By: Nikola || Source Answers: As answered on slack you can use TemplatedConfigLoader, but beware …
Getting Kedro Custom Dataset for SunPy Maps to write to/from S3 Question: I’m currently attempting to define a custom dataset to read/write .fits files to/from S3 as SunPy Maps. The closest thing to this already in the data catalog is the pillow.ImageDataSet pillow.ImageDataSet, which supports passing a file object when loading: https://pillow.readthedocs.io/en/stable/reference/Image.html. I’m unsure if …
How to pass a literal value to a kedro node? Question: I’ve got a function def do_something(input_data, column: int): # Do something with one column of the data Now I need to create a kedro node, but I can’t do node(do_something, ["input_data", 1], "output"). How can I put the constant value (1) into the node? …
