Hacker News

Introduction to Bert(towardsml.com)

148 pointsseshagiric posted 7 months ago10 Comments
inertiatic said 7 months ago:

I was hoping this would be more comprehensive, breaking down the transformer architecture as well. Anyone got a resource like this?

ma2rten said 7 months ago:
inertiatic said 7 months ago:

Wow, I didn't expect such a detailed write up that is still meant for people without a great overview of all the advancements leading up to this.

I'll certainly start digging into this tonight.

liuliu said 7 months ago:
inertiatic said 7 months ago:

Thank you, this also seems great although more of a practical resource it seems. I'll go through this after I have a base intuition from the other resource.

hinkley said 7 months ago:

You know how in movies the "alien" learned the language and customs from popular media and so the story pokes fun at them for how oddly they behave (and how odd our popular media is). From this article, it seems like NLP people are essentially worried about the same thing happening.

Now I have a vision of Dan Akroyd and Steve Martin -esque computers announcing that "we are... two wild and crrrazy guys!"

bitwize said 7 months ago:

That was a movie too -- Short Circuit (1986).

"Wouldn't you like to be a Pepper too?"

RickJWagner said 7 months ago:

A timely post, as December is prime 'Bert' month.

If Bert & Ernie are only Sesame Street characters to you, please watch "It's a Wonderful Life" (carefully) this holiday season. I think that's where Sesame Street got the names.

emmelaich said 7 months ago:

Interesting, but a little Googling tells me that the writers deny that. It's just a coincidence.

Perhaps Jim Henson subconsciously remembered them though.

Communitivity said 7 months ago:

I went there expecting something about Binary Erlang Term (BERT) [1]. It's unfortunate the acronym clashes, though with so many acronyms it is bound to happen. Interesting article though.

[1] http://bert-rpc.org/