The bleak future of Artificial Intelligence in Singapore
On 9th Feb, the National University of Singapore implemented broad restrictions against the use of AI tools to generate work:
Fast (5x) Inference with TorToiSe-TTS
I made a fork of TorToiSe with much faster inference speed. Here are the summarised results:
Contrastive Search might-not-be What You Need
TL;DR
- GPT-NeoX-20B appears to be anisotropic (Isotropy: 0.197)
- Int8 quantisation appears to have ~no effect on isotropy
- I am new to ML so the above could be false, feel free to poke at my findings here
An Informal Reminder
Why Language Models?
A preface to the upcoming series on my attempts to use language models, locally