model icon indicating copy to clipboard operation
model copied to clipboard

Update docs with benchmark tutorial

Open brunosan opened this issue 2 years ago • 2 comments

After #117 has closed, I think we should update the documentation in two places, which I think are both small changes:

  • [ ] Add a new model benchmark section, so in all future versions we compared how the scores are improving.
  • [ ] Add the code in the finetune section to help users apply finetuned for a random places with random labeled data, using the floods as the example.

brunosan avatar Jan 30 '24 13:01 brunosan

Re-upping this @yellowcap - can we incorporate this in the next sprint?

lauracchen avatar Mar 06 '24 16:03 lauracchen

Potentially, we did work on this back in December and early January, but without having a finalized version. In January we de-prioritized the systematic benchmarking in favor of creating more hands-on examples.

@lillythomas what would it take to document how to do fine tuning?

Refs https://github.com/Clay-foundation/model/pull/87 https://github.com/Clay-foundation/model/issues/117

yellowcap avatar Mar 08 '24 09:03 yellowcap

Closing as out of date, feel free to re-open if appropriate.

yellowcap avatar Jun 05 '24 10:06 yellowcap