Releasing pretrained models

[sverneka]

Hi, Will you be releasing weights of T0 (3B) pre-trained via (IA)^3?

[dptam]

Hi, yea it is under pretrained_checkpoints.

[aflah02]

@dptam Did you also release other baseline models? I'm doing some downstream analysis which would significantly benefit if all the PEFT baseline models were available.

[dptam]

Sorry we only released the pre-trained checkpoints. However, this code can be used to train the PEFT baselines.

[aflah02]

@dptam Thanks for the quick reply!