Module llmsearch.utils

Contains useful utilities that help with the functioning of llmsearch.

Sub-modules

llmsearch.utils.common_utils

Common utilties

llmsearch.utils.gen_utils

Generation Related Utilties …

llmsearch.utils.logging_utils

Logging Related Utils

llmsearch.utils.mem_utils

Inspired from toma, Memory related utils to do friendly inference.

llmsearch.utils.model_downloader

Model downloader - https://github.com/oobabooga/text-generation-webui/blob/main/download-model.py

llmsearch.utils.model_utils

Common Utilties for Models