Linux Dependency Requirements? #137
Description
Related: #93
I am trying to make a Docker Container for koboldcpp-rocm and is a little bit confused by the pyinstaller options listed in the make_pyinstaller.sh.
If the dependency requirements is that the system only needs rocm installed but not hipblas,
then it should bundle all hipblas related so files and the rocblas directory.
However, I am getting missing libhipblaslt.so and librocsolver.so if these are absent.
If the dependency requirements is that the system needs hipblas installed,
then it should not need to bundle any files from /opt/rocm.
If the dependency requirements is that the system only needs rocminfo and rocm-smi binaries,
then it should bundle all necessary files from /opt/rocm.
For now, I ended up preparing the /opt/rocm directory separately with koboldcpp only containing files in the build root specified by the pyinstaller command since rocm-smi also needs python3 to function.
I can make a PR if adjustments are needed for the make_pyinstaller.sh script.
My Dockerfile can be found here.