modules package

Submodules

modules.llava_benchmark module

class modules.llava_benchmark.LlavaBenchmark(benchmarks: List)

Bases: object

LLaVA Benchmark class for processing media and storing results.

benchmarks

List of benchmark instances.

Type:

list

average_and_plot_benchmarks() → None

Calculate the average evaluation rates and plot them.

process_media(media_file: str) → tuple

Process media file and return relevant information.

Parameters:

media_file (str) – Path to the media file.

Returns:

A tuple containing transcript (str) and media file path (str).

Return type:

tuple

store_results(benchmark_result: str, model: str, media_file_path: str) → None

Store the benchmark results.

Parameters:

• benchmark_result (subprocess.CompletedProcess) – Result of the subprocess.run call.

• model (str) – The name of the model to use.

• media_file_path (str) – The media file path.

modules.ollama module

class modules.ollama.Ollama

Bases: object

static is_binary_installed()

Checks if the ollama binary is present on the system.

Returns:

True if ollama binary is present, False otherwise.

Return type:

bool

static is_model_installed(model: str)

Checks if a given model is installed.

Parameters:

model (str) – The name of the model to check.

Returns:

True if the model is installed, False otherwise.

Return type:

bool

static print_prompt(prompt: str) → None

Print the formatted prompt.

Parameters:

prompt (str) – The prompt to print.

static read_yaml(yaml_file_path: str)

Reads a YAML file and returns its content as a dictionary.

Parameters:

yaml_file_path (str) – Path to the YAML file.

Returns:

Parsed YAML data.

Return type:

dict

static run_benchmark(model: str, prompt: str, media_file_path: str) → CompletedProcess

Run a benchmark using the specified model, prompt, and media file path.

Parameters:

• model (str) – The name of the model to use.

• prompt (str) – The prompt for the benchmark.

• media_file_path (str) – The path to the media file.

Returns:

The result of the benchmark execution.

Return type:

subprocess.CompletedProcess

Module contents