bash

Removing Duplicate Domain URLs From the Text File Using Bash Question: Text file https://www.google.com/1/ https://www.google.com/2/ https://www.google.com https://www.bing.com https://www.bing.com/2/ https://www.bing.com/3/ Expected Output: https://www.google.com/1/ https://www.bing.com What I Tried awk -F’/’ ‘!a[$3]++’ $file; Output https://www.google.com/1/ https://www.google.com https://www.bing.com https://www.bing.com/2/ I already tried various codes and none of them work as expected. I just want to pick only one unique …

Calling python script from bash script and getting it's return value Question: I’ve bash script doing some tasks but I need to manipulate on string obtained from configuration (for simplification in this test it’s hardcoded). This manipulation can be done easily in python but is not simple in bash, so I’ve written a script in …

Passing arguments through Docker to argparse not working Question: The setup I have a dockercontainer with the following Dockerfile: FROM python:3.10 WORKDIR /usr/src/app ENV ARGS="" COPY requirements.txt ./ COPY main.py ./ COPY … COPY … COPY … RUN apt update RUN apt install ffmpeg -y RUN apt install wkhtmltopdf -y RUN pip install –no-cache-dir -r …

sed and rev shell command into Python script Question: There is a shell command, I am trying to convert the logic into python. But I don’t know what to do, I need some help with that. shell command is this : cd ../../../tests/src/main/test ls find . -name ‘*.vrlp’ | while read FILENAME do TEST_CASE=`echo $FILENAME …

Shell find logic into Python script Question: cd db/test/vs ls find . -name ‘*.vrlp’ | while read FILENAME do TEST_CASE=`echo $FILENAME | sed s/"./"//g | sed s/".vrlp"//g | rev | cut -f1 -d"/" | rev` CLASS=`echo $FILENAME | sed s/"./"//g | sed s/"/$TEST_CASE"//g | sed s/".vrlp"//g` done There are a lot of class files (FILENAME) …

sed shell command into Python script Question: There is a shell command, I am trying to convert the logic into python. But I don’t know what to do, I need some help with that. shell command is this : cd ../../../tests/src/main/java ls grep -R "@Test" -A 1 | grep void | while read LINE do …

Delete all paragraphs that begin with time (HH:mm) and end with specific string from multiple files Question: I need to delete any paragraphs/blocks of text that begin with a time in HH:mm format and end with a specific string from a large number of files in a folder. Each paragraph that needs deleting ends with …

How do I combine 2 lines at a time, appending line1 onto line2, pulling only specific parts of each line in Bash? Question: I have millions of short input files. PyLauncher will run on supercomputers, running millions of python scripts in parallel. Each runs a program on each input and copies 2 lines from the …

Translate multi-command pipeline bash to python Question: This is what I have in my bash script: example=$(echo $var | cut -c 40- | sed "/[a-zA-Z0-9]$/!d"). I am trying to translate it to python. In Python, echo $var | cut -c 40- would give print(var[40]). And I know that [a-zA-Z0-9] means any character in the range …

Translating Bash function call to Python Question: I am trying to translate this from Bash to Python: password=$(func_name "${configFile}" "<password" "2") func_name and configFile have been defined earlier in the script. func_name is a function and configFile is a working directory leading to an XML file. But I don’t know what to do with func_name …