Call another click command from a click command
Question:
I want to use some useful functions as commands. For that I am testing the click library. I defined my three original functions then decorated as click.command:
import click
import os, sys
@click.command()
@click.argument('content', required=False)
@click.option('--to_stdout', default=True)
def add_name(content, to_stdout=False):
if not content:
content = ''.join(sys.stdin.readlines())
result = content + "ntadded name"
if to_stdout is True:
sys.stdout.writelines(result)
return result
@click.command()
@click.argument('content', required=False)
@click.option('--to_stdout', default=True)
def add_surname(content, to_stdout=False):
if not content:
content = ''.join(sys.stdin.readlines())
result = content + "ntadded surname"
if to_stdout is True:
sys.stdout.writelines(result)
return result
@click.command()
@click.argument('content', required=False)
@click.option('--to_stdout', default=False)
def add_name_and_surname(content, to_stdout=False):
result = add_surname(add_name(content))
if to_stdout is True:
sys.stdout.writelines(result)
return result
This way I am able to generate the three commands add_name, add_surname and add_name_and_surname using a setup.py file and pip install --editable . Then I am able to pipe:
$ echo "original content" | add_name | add_surname
original content
added name
added surname
However there is one slight problem I need to solve, when composing with different click commands as functions:
$echo "original content" | add_name_and_surname
Usage: add_name_and_surname [OPTIONS] [CONTENT]
Error: Got unexpected extra arguments (r i g i n a l c o n t e n t
)
I have no clue why it does not work, I need this add_name_and_surname command to call add_name and add_surname not as command but as functions, else it defeats my original purpose of using functions as both library functions and commands.
Answers:
When you call add_name() and add_surname() directly from another function, you actually call the decorated versions of them so the arguments expected may not be as you defined them (see the answers to How to strip decorators from a function in python for some details on why).
I would suggest modifying your implementation so that you keep the original functions undecorated and create thin click-specific wrappers for them, for example:
def add_name(content, to_stdout=False):
if not content:
content = ''.join(sys.stdin.readlines())
result = content + "ntadded name"
if to_stdout is True:
sys.stdout.writelines(result)
return result
@click.command()
@click.argument('content', required=False)
@click.option('--to_stdout', default=True)
def add_name_command(content, to_stdout=False):
return add_name(content, to_stdout)
You can then either call these functions directly or invoke them via a CLI wrapper script created by setup.py.
This might seem redundant but in fact is probably the right way to do it: one function represents your business logic, the other (the click command) is a “controller” exposing this logic via command line (there could be, for the sake of example, also a function exposing the same logic via a Web service for example).
In fact, I would even advise to put them in separate Python modules – Your “core” logic and a click-specific implementation which could be replaced for any other interface if needed.
Due to the click decorators the functions can no longer be called just by specifying the arguments.
The Context class is your friend here, specifically:
- Context.invoke() – invokes another command with the arguments you supply
- Context.forward() – fills in the arguments from the current command
So your code for add_name_and_surname should look like:
@click.command()
@click.argument('content', required=False)
@click.option('--to_stdout', default=False)
@click.pass_context
def add_name_and_surname(ctx, content, to_stdout=False):
result = ctx.invoke(add_surname, content=ctx.forward(add_name))
if to_stdout is True:
sys.stdout.writelines(result)
return result
Reference:
http://click.pocoo.org/6/advanced/#invoking-other-commands
I found these solutions more complicated. I wanted this function below to be called from another place in another package:
@click.command(help='Clean up')
@click.argument('path', nargs=1, default='def')
@click.option('--info', '-i', is_flag=True,
help='some info1')
@click.option('--total', '-t', is_flag=True,
help='some info2')
def clean(path, info, total):
#some definition, some actions
#this function will help us
def get_function(function_name):
if function_name == 'clean':
return clean
I have another package, so, I would like click command above in this pack
import somepackage1 #here is clean up click command
from click.testing import CliRunner
@check.command(context_settings=dict(
ignore_unknown_options=True,
))
@click.argument('args', nargs=-1)
@click.pass_context
def check(ctx, args):
runner = CliRunner()
if len(args[0]) == 0:
logger.error('Put name of a command')
if len(args) > 0:
result = runner.invoke(somepackage1.get_function(args[0]), args[1:])
logger.print(result.output)
else:
result = runner.invoke(somepackage1.get_function(args[0]))
logger.print(result.output)
So, it works.
python somepackage2 check clean params1 --info
You can also call a Click function using the callback member function under some conditions. As per this GitHub issue:
Assuming you know the given command is a direct wrapper for a function you wrote (and not a group or other type of command), you can get at the function with command.callback. However, calling it will just call the function, it won’t invoke any of the Click pipeline for validation, callbacks, etc.
Your example will become:
(...)
def add_name_and_surname(content, to_stdout=False):
result = add_surname.callback(add_name.callback(content))
(...)
I want to use some useful functions as commands. For that I am testing the click library. I defined my three original functions then decorated as click.command:
import click
import os, sys
@click.command()
@click.argument('content', required=False)
@click.option('--to_stdout', default=True)
def add_name(content, to_stdout=False):
if not content:
content = ''.join(sys.stdin.readlines())
result = content + "ntadded name"
if to_stdout is True:
sys.stdout.writelines(result)
return result
@click.command()
@click.argument('content', required=False)
@click.option('--to_stdout', default=True)
def add_surname(content, to_stdout=False):
if not content:
content = ''.join(sys.stdin.readlines())
result = content + "ntadded surname"
if to_stdout is True:
sys.stdout.writelines(result)
return result
@click.command()
@click.argument('content', required=False)
@click.option('--to_stdout', default=False)
def add_name_and_surname(content, to_stdout=False):
result = add_surname(add_name(content))
if to_stdout is True:
sys.stdout.writelines(result)
return result
This way I am able to generate the three commands add_name, add_surname and add_name_and_surname using a setup.py file and pip install --editable . Then I am able to pipe:
$ echo "original content" | add_name | add_surname
original content
added name
added surname
However there is one slight problem I need to solve, when composing with different click commands as functions:
$echo "original content" | add_name_and_surname
Usage: add_name_and_surname [OPTIONS] [CONTENT]
Error: Got unexpected extra arguments (r i g i n a l c o n t e n t
)
I have no clue why it does not work, I need this add_name_and_surname command to call add_name and add_surname not as command but as functions, else it defeats my original purpose of using functions as both library functions and commands.
When you call add_name() and add_surname() directly from another function, you actually call the decorated versions of them so the arguments expected may not be as you defined them (see the answers to How to strip decorators from a function in python for some details on why).
I would suggest modifying your implementation so that you keep the original functions undecorated and create thin click-specific wrappers for them, for example:
def add_name(content, to_stdout=False):
if not content:
content = ''.join(sys.stdin.readlines())
result = content + "ntadded name"
if to_stdout is True:
sys.stdout.writelines(result)
return result
@click.command()
@click.argument('content', required=False)
@click.option('--to_stdout', default=True)
def add_name_command(content, to_stdout=False):
return add_name(content, to_stdout)
You can then either call these functions directly or invoke them via a CLI wrapper script created by setup.py.
This might seem redundant but in fact is probably the right way to do it: one function represents your business logic, the other (the click command) is a “controller” exposing this logic via command line (there could be, for the sake of example, also a function exposing the same logic via a Web service for example).
In fact, I would even advise to put them in separate Python modules – Your “core” logic and a click-specific implementation which could be replaced for any other interface if needed.
Due to the click decorators the functions can no longer be called just by specifying the arguments.
The Context class is your friend here, specifically:
- Context.invoke() – invokes another command with the arguments you supply
- Context.forward() – fills in the arguments from the current command
So your code for add_name_and_surname should look like:
@click.command()
@click.argument('content', required=False)
@click.option('--to_stdout', default=False)
@click.pass_context
def add_name_and_surname(ctx, content, to_stdout=False):
result = ctx.invoke(add_surname, content=ctx.forward(add_name))
if to_stdout is True:
sys.stdout.writelines(result)
return result
Reference:
http://click.pocoo.org/6/advanced/#invoking-other-commands
I found these solutions more complicated. I wanted this function below to be called from another place in another package:
@click.command(help='Clean up')
@click.argument('path', nargs=1, default='def')
@click.option('--info', '-i', is_flag=True,
help='some info1')
@click.option('--total', '-t', is_flag=True,
help='some info2')
def clean(path, info, total):
#some definition, some actions
#this function will help us
def get_function(function_name):
if function_name == 'clean':
return clean
I have another package, so, I would like click command above in this pack
import somepackage1 #here is clean up click command
from click.testing import CliRunner
@check.command(context_settings=dict(
ignore_unknown_options=True,
))
@click.argument('args', nargs=-1)
@click.pass_context
def check(ctx, args):
runner = CliRunner()
if len(args[0]) == 0:
logger.error('Put name of a command')
if len(args) > 0:
result = runner.invoke(somepackage1.get_function(args[0]), args[1:])
logger.print(result.output)
else:
result = runner.invoke(somepackage1.get_function(args[0]))
logger.print(result.output)
So, it works.
python somepackage2 check clean params1 --info
You can also call a Click function using the callback member function under some conditions. As per this GitHub issue:
Assuming you know the given command is a direct wrapper for a function you wrote (and not a group or other type of command), you can get at the function with command.callback. However, calling it will just call the function, it won’t invoke any of the Click pipeline for validation, callbacks, etc.
Your example will become:
(...)
def add_name_and_surname(content, to_stdout=False):
result = add_surname.callback(add_name.callback(content))
(...)