15 subscribers
Player FM uygulamasıyla çevrimdışı Player FM !
Dinlemeye Değer Podcast'ler
SPONSOR


1 You Can Visit All Seven Continents. But Should You? 26:46
[ML News] BLOOM: 176B Open-Source | Chinese Brain-Scale Computer | Meta AI: No Language Left Behind
Manage episode 336565836 series 2974171
#mlnews #bloom #ai
Today we look at all the recent giant language models in the AI world!
OUTLINE:
0:00 - Intro
0:55 - BLOOM: Open-Source 176B Language Model
5:25 - YALM 100B
5:40 - Chinese Brain-Scale Supercomputer
7:25 - Meta AI Translates over 200 Languages
10:05 - Reproducibility Crisis Workshop
10:55 - AI21 Raises $64M
11:50 - Ian Goodfellow leaves Apple
12:20 - Andrej Karpathy leaves Tesla
12:55 - Wordalle
References:
BLOOM: Open-Source 176B Language Model
https://bigscience.huggingface.co/blo...
https://huggingface.co/spaces/bigscie...
https://huggingface.co/bigscience/blo...
YALM 100B
https://github.com/yandex/YaLM-100B
Chinese Brain-Scale Supercomputer
https://www.scmp.com/news/china/scien...
https://archive.ph/YaoA6#selection-12...
Meta AI Translates over 200 Languages
https://ai.facebook.com/research/no-l...
Reproducibility Crisis Workshop
https://reproducible.cs.princeton.edu/
AI21 Raises $64M
https://techcrunch.com/2022/07/12/ope...
Ian Goodfellow leaves Apple
https://twitter.com/goodfellow_ian/st...
Andrey Karpathy leaves Tesla
https://mobile.twitter.com/karpathy/s...
https://www.businessinsider.com/repor...
Wordalle
https://huggingface.co/spaces/hugging...
Links:
Homepage: https://ykilcher.com
Merch: ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannick...
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
177 bölüm
Manage episode 336565836 series 2974171
#mlnews #bloom #ai
Today we look at all the recent giant language models in the AI world!
OUTLINE:
0:00 - Intro
0:55 - BLOOM: Open-Source 176B Language Model
5:25 - YALM 100B
5:40 - Chinese Brain-Scale Supercomputer
7:25 - Meta AI Translates over 200 Languages
10:05 - Reproducibility Crisis Workshop
10:55 - AI21 Raises $64M
11:50 - Ian Goodfellow leaves Apple
12:20 - Andrej Karpathy leaves Tesla
12:55 - Wordalle
References:
BLOOM: Open-Source 176B Language Model
https://bigscience.huggingface.co/blo...
https://huggingface.co/spaces/bigscie...
https://huggingface.co/bigscience/blo...
YALM 100B
https://github.com/yandex/YaLM-100B
Chinese Brain-Scale Supercomputer
https://www.scmp.com/news/china/scien...
https://archive.ph/YaoA6#selection-12...
Meta AI Translates over 200 Languages
https://ai.facebook.com/research/no-l...
Reproducibility Crisis Workshop
https://reproducible.cs.princeton.edu/
AI21 Raises $64M
https://techcrunch.com/2022/07/12/ope...
Ian Goodfellow leaves Apple
https://twitter.com/goodfellow_ian/st...
Andrey Karpathy leaves Tesla
https://mobile.twitter.com/karpathy/s...
https://www.businessinsider.com/repor...
Wordalle
https://huggingface.co/spaces/hugging...
Links:
Homepage: https://ykilcher.com
Merch: ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannick...
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
177 bölüm
כל הפרקים
×
1 Efficient Streaming Language Models with Attention Sinks (Paper Explained) 32:26

1 Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution (Paper Explained) 46:44

1 Retentive Network: A Successor to Transformer for Large Language Models (Paper Explained) 28:25

1 Reinforced Self-Training (ReST) for Language Modeling (Paper Explained) 53:06

1 [ML News] LLaMA2 Released | LLMs for Robots | Multimodality on the Rise 44:10

1 How Cyber Criminals Are Using ChatGPT (w/ Sergey Shykevich) 29:08

1 DeepFloyd IF - Pixel-Based Text-to-Image Diffusion (w/ Authors) 53:31

1 [ML News] GPT-4 solves MIT Exam with 100% ACCURACY | OpenLLaMA 13B released 31:04

1 Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust (Explained) 35:44

1 RWKV: Reinventing RNNs for the Transformer Era (Paper Explained) 1:02:16

1 Tree of Thoughts: Deliberate Problem Solving with Large Language Models (Full Paper Review) 29:28

1 OpenAI suggests AI licenses (US Senate hearing on AI regulation w/ Sam Altman) 16:12

1 [ML News] Geoff Hinton leaves Google | Google has NO MOAT | OpenAI down half a billion 39:06

1 Scaling Transformer to 1M tokens and beyond with RMT (Paper Explained) 24:33
Player FM'e Hoş Geldiniz!
Player FM şu anda sizin için internetteki yüksek kalitedeki podcast'leri arıyor. En iyi podcast uygulaması ve Android, iPhone ve internet üzerinde çalışıyor. Aboneliklerinizi cihazlar arasında eş zamanlamak için üye olun.