FlagOpen/FlagEmbedding v1.3.2-BGE-Update

1.3.2

on GitHub

We have completely updated the BGE code repository, including the following key improvements:

Inference Code

• Added FlagAutoModel and FlagAutoReranker, making it easier to utilize the models.

Inference Optimization

• Implemented multi-GPU support.
• Introduced dynamic batch sizing to prevent out-of-memory (OOM) issues.
• Optimized padding to improve efficiency.

Evaluation Code

• Integrated support for common evaluation datasets to enhance user convenience.
• Provided a custom evaluation interface, adhering to specified data organization standards, to simplify the evaluation process.

Project Structure Organization

• Reorganized the project to streamline processes related to inference, fine-tuning, and evaluation.