pytorch-gpu: Use mamba to enable wildcards

Conda gave an error, when trying to build the image with kaniko:
Found invalid version predicate in "*.*"

Mamba seems to work, at least with removed `--no-update-deps`.