Python – Activate conda env through shell script

I use ‘source command’ to run the shell script, it works:

source shell_script.sh

Quick solution for bash: prepend the following init script into your Bash scripts.

eval "$(command conda 'shell.bash' 'hook' 2> /dev/null)"

Done.

For other shells, check the init conf of your shell, copy the following content within the shell conf and prepend it into your scripts.

# >>> conda initialize >>>
...
# <<< conda initialize <<<

You can also use

conda init --all --dry-run --verbose

to get the init script you need in your scripts.

Explanation

This is related with the introduction of conda init in conda 4.6.

Quote from conda 4.6 release log

Conda 4.4 allowed “conda activate envname”. The problem was that setting up your shell to use this new feature was not always straightforward. Conda 4.6 adds extensive initialization support so that more shells than ever before can use the new “conda activate” command. For more information, read the output from “conda init –help”

After conda init is introduced in conda 4.6, conda only expose command
conda into the PATH but not all the binaries from “base”. And environment switch is unified by conda activate env-name and conda deactivate on all platforms.

But to make these new commands work, you have to do an additional initialization with conda init.

The problem is that your script file is run in a sub-shell, and conda is not initialized in this sub-shell.

References

• Conda 4.6 Release
• Unix shell initialization
• Shell startup scripts

What is the problem with simply doing something like this in your shell:

source /opt/conda/etc/profile.d/conda.sh

(The conda init is still marked as Experimental, and thus not sure if it is a good idea to use it yet).

Using conda activate or source activate in shell scripts does not always work and can throw errors like this. An easy work around it to place source ~/miniconda3/etc/profile.d/conda.sh above any conda activate command in the script:

source ~/miniconda3/etc/profile.d/conda.sh # Or path to where your conda is
conda activate some-conda-environment

This is the solution that has worked for me and will also work if sharing scripts. This also gets around having to use conda init as on some clusters I have worked with the system is initialised but conda activate still won’t work in a shell script.

I also had the exact same error when trying to activate conda env from C++ or Python file. I solved it by bypassing the conda activate statement and using the absolute path of the specific conda env.

For me, I set up an environment called "testenv" using conda.

I searched all python environments using

whereis python | grep 'miniconda'

It returned a list of python environments. Then I ran my_python_file.py using the following command.

~/miniconda3/envs/testenv/bin/python3.8 my_python_file.py

You can do the same thing on windows too but looking up for python and conda python environments is a bit different.

if you want to use the shell script to run the other python file in the other conda env, just run the other file via the following command.

os.system('conda run -n <env_name> python <path_to_other_script>')

   #open terminal or CMD as administrator

$ cd <path Anaconda3 install>Scripts

$ activate

$ cd .. 

$ conda activate scratch

This answer is similar to @Lamma answer. This worked for me ->

(1) I defined several variables; the conda activate function, environments directory and environment

conda_activate=~/anaconda3/bin/activate
conda_envs_dir=~/anaconda3/envs
conda_env=<env name>

(2) I source conda activate with the environment

source ${conda_activate} ${conda_envs_dir}/${conda_env}

(3) then you can run your python script

python <path to script.py>

This bypasses the conda init requirement. my .bashrc already was initialized and sourcing the .bashrc file didn’t work for me. @Lamma’s answer worked for me as well as the above code.

I just followed a similar solution like the one from hong-xu

So to run a shell command that calls the script with arguments and using a specific conda environment:

from a jupyter cell, goes like this :

p1 = <some-value>
run = f"conda run -n {<env-name>} python {<script-name>.py} 
    --parameter_1={p1}"

!{run}

I didn’t find any of the above scripts useful. These are fine if you want to run conda in non-interactive mode, but I’d like to run it in interactive mode. If I run:

conda activate my_environment 

in a bash script it just runs in the script.

I found that creating an alias in .bashrc is all that is required to change directory to a particular project I’m working on, and set up the correct conda environment for me. So I included in .bashrc:

alias my_environment="cd ~/subdirectory/my_project && conda activate my_environment"

and then:

source ~/.bashrc

Then I can just type at the command line:

my_environment

to change to the correct project and correct environment everytime I want to work on a different project.

$ conda activate scratch

or

$ source activate scratch

This answer from Github worked for me (I’m using Ubuntu so it’s not for Windows only):

eval "$(conda shell.bash hook)"
conda activate my_env

The problem is that when you run the bash script, a new (linux) shell environment is created that was not initialized properly. If your intention is to activate a conda environment, and then run python through the script, you can properly initialize the created shell
environment as discussed in the accepted solution.

If however you want to have the conda environment active after you finish this script, then this will not work because the conda environment has changed on the new shell and you exit that shell when you finish the script. Think of this as running bash, then conda activate... then running exit to exit that bash… More details in How to execute script in the current shell on Linux?:

TL;DR:

1. Add the line #!/bin/bash as the first line of the script
2. Type the command source shell_script.sh or . shell_script.sh

Note: . in bash is equivalent to source in bash.

tl;dr #!/bin/bash -i worked for me.