tokenizeHow to detect outofvocab

tokenize - How to detect out-of-vocabulary words in a prompt - Stack Overflow
I need to detect words an LLM has no knowledge about, to add RAG-based definition of said word to the p
tokenizeHow to detect outofvocabulary words in a promptStack Overflow
admin5小时前
10