So "my" A.I. just generated this piece of text!

[wonder]

So I've been fine-tuning a GPT-2 (345M) model with Harry Potter books.

It generated this

Conclusion: The deeper the network, the deeper the bullsh*t!

 

[aeric]

Our model, called GPT-2 (a successor to GPT), was trained simply to predict the next word in 40GB of Internet text.

I guessed the bullshit lies inside the 40GB of Internet text.

 

[emexes]

I did that with.. uh, erotic fiction, and the output was disturbingly indistinguishable from the input.

 

[wonder]

Someone made a website out of it: https://talktotransformer.com/

 

[wonder]

I guessed the bullshit lies inside the 40GB of Internet text.

Unfortunately we don't have access to the higher models (yet). In my case, I'm using the 345M model.