Hacker News

Introduction to Bert(towardsml.com)

148 pointsseshagiric posted 6 days ago10 Comments
10 Comments:
inertiatic said 6 days ago:

I was hoping this would be more comprehensive, breaking down the transformer architecture as well. Anyone got a resource like this?

ma2rten said 6 days ago:
inertiatic said 5 days ago:

Wow, I didn't expect such a detailed write up that is still meant for people without a great overview of all the advancements leading up to this.

I'll certainly start digging into this tonight.

liuliu said 5 days ago:
inertiatic said 5 days ago:

Thank you, this also seems great although more of a practical resource it seems. I'll go through this after I have a base intuition from the other resource.

hinkley said 6 days ago:

You know how in movies the "alien" learned the language and customs from popular media and so the story pokes fun at them for how oddly they behave (and how odd our popular media is). From this article, it seems like NLP people are essentially worried about the same thing happening.

Now I have a vision of Dan Akroyd and Steve Martin -esque computers announcing that "we are... two wild and crrrazy guys!"

bitwize said 5 days ago:

That was a movie too -- Short Circuit (1986).

"Wouldn't you like to be a Pepper too?"

RickJWagner said 6 days ago:

A timely post, as December is prime 'Bert' month.

If Bert & Ernie are only Sesame Street characters to you, please watch "It's a Wonderful Life" (carefully) this holiday season. I think that's where Sesame Street got the names.

emmelaich said 6 days ago:

Interesting, but a little Googling tells me that the writers deny that. It's just a coincidence.

Perhaps Jim Henson subconsciously remembered them though.

Communitivity said 5 days ago:

I went there expecting something about Binary Erlang Term (BERT) [1]. It's unfortunate the acronym clashes, though with so many acronyms it is bound to happen. Interesting article though.

[1] http://bert-rpc.org/