Hi I am trying to generate a 20 token text using GPT-2 simple. It is taking me around 15 seconds to generate the sentence. AI Dungeon is taking around 4 seconds
Im trying to use firebase serve in order to get my localhost url I can't seem to move past this issue. Here is my index.js const functions = require('fireba
Right now I have: model = GPTNeoForCausalLM.from_pretrained(model_name) tokenizer = GPT2Tokenizer.from_pretrained(model_name) input_ids = tokenizer(prompt, retu