| Age | Commit message (Collapse) | Author | Files | Lines |
|
|
|
|
|
|
|
|
|
It's actually pretty easy to see whether a snippet is a complete
sentence, just append an extra word and see if it tokenizes into two
sentences or just one. This should be a lot more reliable.
|
|
Sometimes the AI generates really long lines.
|
|
I'm actually getting way better results from gpt2. Now gpt2 is my new
best friend!
|
|
|
|
|
|
|
|
It kind of feels bad to depend on nltk and hugging face, but we're doing
the best we can. Too bad that nltk isn't easier to install, too.
|
|
The sentence tokenizer wasn't correct because not all sentences end in
periods. The current regexp doesn't handle punctuation inside words such
as apostrophes or abbreviations, but we're trying it. Maybe a tokenizer
would be better?
|
|
|
|
|
|
This is a clone of the AI dungeon game made using a HugginFace
transformer. It works pretty well all things considered, but requires
some hand-holding to generate ok output. Well, the original AI dungeon
was the same way. I'll keep tweaking settings and make it even better.
|