An Experiment defines the machine learning task you’re fine-tuning for. A Run refers to a single execution of the Experiment with a specific configuration. An Experiment contains a list of Runs, each with different configurations. For example:
Experiment: Fine-tune a transformer on the QuoraQA dataset.
Run1: Use bert-based model.
Run2: Use sentence-transformer model.
Experiment: Fine-tune ResNet on WILD dataset.
Run1: Use ResNet18 with learning rate 0.01 and SGD optimizer.
Run2: Use ResNet50 with learning rate 0.01 and SGD optimizer.
Run3: Use ResNet50 with learning rate 0.0001 and Adam optimizer.
All information and data produced during using Finetuner is linked to those two concepts. Each Experiment and each Run has a name. The name of the Experiment should be unique and the name of the Run is also required to be unique for each Experiment. Thus, if you want to retrieve the logs of a run or download the fine-tuned model later on, you can do this with the respective experiment and run names, as explained in section Save Artifact.
When you start the fine-tuning job, you can declare the
run_name like this:
import finetuner finetuner.fit( ..., experiment_name='quora-qa-finetune', run_name='quora-qa-finetune-bert', )
Please note that these two arguments are optional.
If not supplied,
Finetuner will use the current working directory as a default
and generate a random
run_name for you, e.g., “infallible-colden”.