DataQualityPerplexity

Name		Name	Last commit message	Last commit date
Latest commit History 9 Commits
__pycache__		__pycache__
data		data
examples		examples
graphs		graphs
.gitignore		.gitignore
GPT_test.py		GPT_test.py
GPT_test_lp1.py		GPT_test_lp1.py
README.md		README.md
alpacadata_finetune.py		alpacadata_finetune.py
compute_perplexity.py		compute_perplexity.py
last_embedding.py		last_embedding.py
library.py		library.py
my_save.json		my_save.json
output.txt		output.txt
requirements.txt		requirements.txt
short_yet_hard_prompts_lp-lt70_w-lt100.txt		short_yet_hard_prompts_lp-lt70_w-lt100.txt
test_library.py		test_library.py
tsne_embeddings.py		tsne_embeddings.py
tsne_visualization.png		tsne_visualization.png
tsne_visualization_miniLM.png		tsne_visualization_miniLM.png
tsne_visualization_phi3.png		tsne_visualization_phi3.png

Provide feedback