From b63051536ff08bb79daf60dad9e5a139b713dc9d Mon Sep 17 00:00:00 2001 From: Gunasekar Date: Mon, 11 Sep 2023 07:56:12 +0000 Subject: [PATCH] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 2f261c9..e618828 100644 --- a/README.md +++ b/README.md @@ -81,7 +81,7 @@ where the model generates the text after the comments. ## Training -### Model (phi-1.5) +### Model * Architecture: a Transformer-based model with next-word prediction objective * Dataset size: 30B tokens * Training tokens: 150B tokens