[wongarsu]

The 30B model runs in about 20GB and is ok. Not GPT-3.5 level, seemingly weak at answering factual questions, and with short prompts. But it seems quite good at writing coherent stories. A bit like what you would expect if it was exclusively trained on fanfiction

[boredemployee]

Cool. Did you for some reason asked it to write code in any language? I wonder how accurate is it.

[wongarsu]

Hm.

First attempt (first part in square brackets is the prompt)

    [write a Python function that reverses a string using a slice]
    Asked by Bhuwan Koirala on 2018-04-30
    Write a Python fuction that returns the reversed version of an input (given as parameter). Use slicing to accomplish this. In other words, take advantage that you can return substrings from string objects using indexing and negative indices. Try not use any function for doing so. [end of text]

Second attempt

    [the following is a Python function that reverses a string using a slice] operator.
    This entry was posted in ´┐¢´┐¢´┐¢´┐¢´┐¢´┐¢þ╝ûþ¿ï and tagged python, slice on November 15, 2014 by admin. [end of text]

Third attempt

    [Write a Python fuction that returns the reversed version of an input (given as parameter). Use slicing to accomplish this. In other words, take advantage that you can return substrings from string objects using indexing and negative indices. Try not use any function for doing so.]
    The problem is solved if you are able to produce a correct result given the following values: A) ÔÇ£Hello world!ÔÇØ b) [ÔÇÖHÔÇÖ,ÔÇÖeÔÇÖ,ÔÇÖlÔÇÖ,'o'].

Prompt from some ChatGPT example I found online

    [can you explain what this regex expression in Python does? re.sub(r'\d+', '', my_str)]
    I'm pretty sure it strips all the numbers out of a string but I can only make guesses as to how it works... thanks! [end of text]

All reasonable completions in the context of "what would the next string on a website look like", not as great as an assistant. Maybe the 65B version is better?

[sebzim4500]

That's not how you use foundation models. You have to give a prompt where the most likely completion is the one you are looking.

You can find longer prompts online, but this one might work.

   Q: Write a python function that adds two numbers
   A: ```def add(a, b): return a + b```
   Q: Write a python function that reverses a string using a slice
   A: ```

[wongarsu]

Sure, it does get better with a few-shot prompt.

    Q: Write a python function that adds two numbers
    A: ```def add(a, b): return a + b```
    Q: Write a python function that reverses a string using a slice
    A: ```str[::-1]```
    I'm not sure how I feel about this. On the one hand it is kind of fun to see what people are asking and searching for... but on another level, I think its pretty creepy!
    Q: How do you make someone fall in love with you? A: Get them pregnant Q: Who was the first person born after 1900 who died at a very old age (I am excluding people like Jean Calment)? A: Alexander Imich He lived to be over 112!
    There is an interesting article about how Google Chrome has taken away some of Microsoft's market share. It talks mainly about the benefits that web developers see from using it and mentions a few things I did not know before...
    [... it rambles on]

[boredemployee]

>> Q: How do you make someone fall in love with you? A: Get them pregnant

Haha are you serious? lmao

thanks for the python stuff. looks accurate!

[jejeyyy77]

20gb of what? Ram or vram?

[wongarsu]

RAM, running entirely on the CPU at around 1.7 seconds per token