,
Last update: Thursday 5/23/24
Last update: Thursday 5/23/24
This weekly news page provides links to reports about major innovations in generative AI. This page is not for AI experts. It's for (1) computer savvy professionals who want to be alert to genAI's potential impact on their careers, and (2) computer savvy citizens who want to be alert to genAI's potential impact on our society.
Most of the links on this page refer to reports published after the "AI Big Bang", i.e., after Sam Altman's dismissal from and return to OpenAI, i.e., after November 20, 2023. The previous edition of this page can be found here ➡ PreBigBang
... Our publication schedule ...
A. OpenAI | B. Microsoft | C. Google | D. Other Models | E. LLM News |
F. SLM News | G. Public Policy | H. Misc | I. Hacks | J. Basics
F. SLM News | G. Public Policy | H. Misc | I. Hacks | J. Basics
Top 3 stories in past week...
Evolving context and connections ...
Fast moving AI news is often exciting, but also confusing. This page is designed to provide readers with an evolving context for the news and reminders of the connections between news items. From time to time, links to older stories whose content has been overcome by newer events will be deleted. However, enough older links will be retained so that readers can get a quick sense of how we got to where we are today by skimming the headlines of the preceding stories in chronological order. No section will ever include more than 12 stories.
Fast moving AI news is often exciting, but also confusing. This page is designed to provide readers with an evolving context for the news and reminders of the connections between news items. From time to time, links to older stories whose content has been overcome by newer events will be deleted. However, enough older links will be retained so that readers can get a quick sense of how we got to where we are today by skimming the headlines of the preceding stories in chronological order. No section will ever include more than 12 stories.
A. OpenAI
- "OpenAI’s Sora Turns AI Prompts Into Photorealistic Videos", Steven Levy, Wired, 2/13/24
-- This story also covered by VentureBeat, The Verge, Bloomberg, TechCrunch, Engadget, Mashable, NY Times
- "Elon Musk Sues OpenAI and Sam Altman for Violating the Company’s Principles", Adam Satariano, Cade Metz and Tripp Mickle, NY Times, 3/1/24
-- A copy of Musk's electronically filed complaint can be found HERE
-- This story also covered by Financial Times, Wired, Bloomberg, Engadget, Washington Post, The Verge, Wall Street Journal, Reuters, BBC, TechCrunch, VentureBeat, NY Times #2 - "Key OpenAI Executive Played a Pivotal Role in Sam Altman’s Ouster", Mike Isaac, Tripp Mickle and Cade Metz, NY Times, 3/7/24
- "Here's Why OpenAI's NEW Robot Is DIFFERENT", AE Uncovered (YouTube video), 3/13/24
-- This story also covered by articles with videos on PC Magazine, Gizmodo, Mashable, Daily Beast ... and OpenAI - "OpenAI Made AI Videos for Us. These Clips Are Good Enough to Freak Us Out.", Joanna Stern, Wall Street Journal, 3/13/24
-- See also "The 12 OpenAI Sora TikToks That Broke Our Brains", Maxwell Zeff. Gizmodo, 3/14/24 - "Exclusive: OpenAI's Altman pitches ChatGPT Enterprise to large firms, including some Microsoft customers ", Krystal Hu and Dawn Chmielewski, Reuters, 4/12/24
- "OpenAI’s Model Spec outlines some basic rules for AI", Emilia David, The Verge, 5/7/24
-- This story also covered by Wired, VentureBeat, InfoWorld, ZDNet, Business Insider, ... and OpenAI ... Model Spec feedback survey form - "OpenAI releases GPT-4o, a faster model that’s free for all ChatGPT users", Kylie Robison, The Verge, 5/13/24
-- This story also covered by Bloomberg, Wired, NY Times, CNET, The Information, MIT Tech Review, ... and OpenAI plus a video demo - "OpenAI chief scientist Ilya Sutskever is officially leaving", Sean Hollister, Kylie Robison, and Alex Heath, The Verge, 5/14/24
-- This story also covered by TechCrunch, BusinessInsider, Wired, NY Times, Ars Technica, The Information, VentureBeat, ... and OpenAI
By the end of the week it was clear that Dr. Sutskever's resignation was just the tip of the iceberg ➡ "OpenAI Staffers Responsible for Safety Are Jumping Ship", Maxwell Zeff, Gizmodo, 5/16/24
-- This story also covered by Vox, Wired, VentureBeat, TechCrunch, Mashable,
B. Microsoft
- "The Inside Story of Microsoft’s Partnership with OpenAI", Charles Duhigg, The New Yorker, 12/1/23
- "Microsoft and Intel strike a custom chip deal that could be worth billions", Wes Davis, The Verge, 2/23/24
-- This story also covered by Reuters, Bloomberg, Wall Street Journal, Engadget, - "Microsoft strikes deal with Mistral in push beyond OpenAI", Madhumita Murgia, Financial Times, 2/26/24
-- This story also covered by VentureBeat, The Verge, Computerworld, TechCrunch, FastCompany, Bloomberg, - "Microsoft Hires DeepMind Co-Founder Suleyman to Run Consumer AI", Dina Bass, Bloomberg, 3/19/24
-- This story also covered by The Verge, TechCrunch, NY Times, Forbes - "Microsoft and OpenAI Plot $100 Billion Stargate AI Supercomputer", Anissa Gardizy and Amir Efrati, The Information, 3/29/24
-- This story also covered by Gizmodo, Reuters, - "Microsoft Makes High-Stakes Play in Tech Cold War With Emirati A.I. Deal", Paul Mozur and David E. Sanger, NY Times, 4/16/24
-- This story also covered by Bloomberg, Reuters, Wall Street Journal, Fortune, Axios ... and Microsoft
C. Google
- "Google DeepMind's Demis Hassabis Says Gemini Is a New Breed of AI", Will Knight, Wired, 12/6/23
-- This story also covered by The Verge, MIT Tech Review, NY Tmes, Ars Technica ... and Google DeepMind
-- Users access Gemini Pro via Bard: "How to Use Google’s Gemini AI Right Now in Its Bard Chatbot", Reece Rogers, Wired, 12/6/23 - "Google’s Ad Sales Fall Short of Wall Street’s Lofty Expectations", Miles Kruppa, Wall Street Journal, 1/30/24
-- This story also covered by NY Times, Forbes, and The Information, 1/31/24 (Link downloads the full paywalled article for 3 free reads) - "Google rebrands Bard chatbot as Gemini, rolls out paid subscription", Jeffrey Dastin, Reuters, 2/8/24
-- This story also covered by VentureBeat, NY Times, ZDNet, Engadget, MIT Tech Review - "Google unveils Gemini 1.5, a next-gen AI model with million-token context window", Michael Nuñez, VentureBeat, 2/15/24
-- This story also covered by The Verge, TechCrunch, Bloomberg, Wired, Mashable - "Google suspends Gemini from making AI images of people after a backlash complaining it was 'woke'", Joshua Zitser, Business Insider, 2/22/24
-- This story also covered byThe Verge, Gizmodo, Wall Street Journal, Fast Company, TechCrunch, Associated Pr.ess, NY Times ... and Google (on X/Twitter) - "Google won’t let you use its Gemini AI to answer questions about an upcoming election in your country", Jagmeet Singh, TechCrunch, 3/13/24
-- This story also covered by Ars Technica, BBC, Reuters, Engadget, - "Apple Is in Talks to Let Google Gemini Power iPhone AI Features", Mark Gurman. Bloomberg, 3/19/24
-- This story also covered by The Information, Reuters. - "Google I/O 2024: Everything revealed including Gemini AI, Android 15 and more", Pranav Dixit, TechCrunch, 5/15/24 ... AI Summary and a video AI summary
-- Overviews of all announcements also provided by Engadget, Wired, The Verge, Business Insider, Mashable,
D. Amazon, Facebook, Anthropic, and other Big Tech models
- "Amazon Takes a Big Stake [$4 G7 conference (Nov 27-Dec 1, Las Vegas, NV)
- -- Overview "Here’s everything Amazon Web Services announced at AWS re:Invent", Christine Hall, TechCrunch, 11/29/23
-- Amazon Q, an AI-powered chatbot for AWS customers ..."Amazon Introduces Q, an A.I. Chatbot for Companies", Karen Weise, NY Times, 11/28/23 ... This story also covered by Bloomberg, VentureBeat, Gizmodo,
-- Image generator "Amazon joins AI image creation fray with new model", Emilia David, The Verge, 11/29/23 ... This story also covered by Bloomberg, Engadget, Gizmodo - "Elon Musk’s Grok Represents a Serious Threat to ChatGPT", Shirin Ghaffary, Bloomberg, 12/14/23
-- This story also covered by Wired, Fast Company, VentureBeat, TechCrunch, - "Adobe’s latest AI experiment generates music from text", Will Shanklin, Engadget, 3/1/24 ... Includes YouTube demo of music generation
-- This story also covered by The Verge, Gizmodo, TechCrunch, - "A.I. Start-Up Anthropic Challenges OpenAI and Google With New Chatbot", Cade Metz, NY Times, 3/4/24
-- This story also covered by TechCrunch, CNBC,CNET, Bloomberg, - "In Latest A.I. War Escalation, Elon Musk Releases Chatbot Code", Kate Conger and Cade Metz, NY Times, 3/17/24
-- This story also covered by TechCrunch, The Verge, Wired, VentureBeat, Mashable, ... and xAI - "Inside the Creation of the World’s Most Powerful Open Source AI Model", Will Knight, Wired, 3/27/24
-- Model is called DBRX ... 136 billion parameters
-- This story also covered by The Information, Business Insider ... and Databricks - "Amazon Adds $2.75 Billion to Its Stake in the A.I. Start-Up Anthropic",Karen Weise, NY Times, 3/27/24
-- This story also covered by Bloomberg, VentureBeat, The Information, Wall Street Journal, TechCrunch - "Elon Musk announces Grok-1.5, nearing GPT-4 level performance", Shubham Sharma, VentureBeat, 3/29/24
-- This story also covered by TechCrunch, Wall Street Journal, Reuters, Endgadget, ... and xAI (Musk) - "Meta’s battle with ChatGPT begins now", Alex Heath, The Verge, 4/18/24
-- This article focuses on Meta's chatbot, the "Meta AI assistant". The chatbot runs on Facebook's new Llama 3 family of open source models. The smaller members of the family are described in greater detail in articles in section "F. Small Language Model news" (below). The huge model has not been released yet.
-- Meta AI is also discussed by Mashable, TechCrunch, Engadget, Wall Street Journal, NY Times,
-- A NY Times tech writer's low rating for MetaAI
"Meta’s A.I. Assistant Is Fun to Use, but It Can’t Be Trusted", Brian X. Chen, NY Times, 4/24/24 - "Anthropic finally releases a Claude mobile app", Emilia David, The Verge, 5/1/24
-- This story also covered by Gizmodo, Bloomberg, Mashable, Engadget, Ars Technica, ... and Anthropic
E. Large Language Model (LLM) news
- "Generative AI isn’t a home run in the enterprise", Kyle Wiggers, TechCrunch, 1/11/24
- "Here are the key differences between the Samsung Galaxy S24 phones", Sheena Vasani, The Verge, 1/18/24
-- This story also covered by Mashable, CNET, The Verge, Wired, Bloomberg ... and Samsung - "Amazon, Google Quietly Tamp Down Generative AI Expectations", Aaron Holmes and Anissa Gardizy, The Information, 3/12/24
- "DeepMind researchers discover impressive learning capabilities in long-context LLMs", Ben Dickson, VentureBeat, 4/24/24
F. Small Language Model (SLM) news
Note: News reports are classified in this category if and only if they explicitly refer to models with less than 70 billion (70B) parameters.
Note: News reports are classified in this category if and only if they explicitly refer to models with less than 70 billion (70B) parameters.
- "Europe’s largest seeded startup Mistral AI releases first model, outperforming Llama 2 13Bx", Shubham Sharma, VentureBeat, 9/27/23 ... Mistral 7B
-- This story also covered by Mistral - "Microsoft releases Phi-2, a small language model AI that outperforms Llama 2, Mistral 7B", Carl Franzen, VentureBeat, 12/12/23
-- This story also covered by ZDNet, TechRepublic, Medium, Computerworld ... and Microsoft - "Allen Institute for AI releases ‘truly open source’ LLM to drive ‘critical shift’ in AI development", Sharon Goldman, VentureBeat, 2/1/24 ... OLMo 7B parameters
-- This story also covered by TechCrunch ... and Allen Institute - "Google goes 'open AI'" with Gemma, a free, open-weights chatbot family", Benj Edwards, Ars Technica, 2/21/24 ...7B and 28B
-- This story also covered by Reuters, Fast Company, Hugging Face, Fortune, NY Times ... and Google - "Generative AI and the big buzz about small language models", Clint Boulton, VentureBeat, 2/29/24
- "Meta releases Llama 3, claims it’s among the best open models available", Kyle Wiggers, TechCrunch, 4/18/24
-- Meta's announcement of Llama 3 ➡ HERE
-- Another Big Tech's opinion: "Elon Musk’s ‘not bad’ review thrusts Meta’s Llama 3 AI into spotlight", Michael Nuñez, VentureBeat, 4/19/24 - "Microsoft Makes a New Push Into Smaller A.I. Systems", Karen Weise and Cade Metz, NY Times, 4/23/24
-- This story also covered by The Verge, Engadget, Ars Technica, ZDNet ... and AI Revolution YouTube Video... and Microsoft ➡ Microsoft benchmarks pdf
G. Public policy and legal considerations
- "AI cannot be patent 'inventor', UK Supreme Court rules in landmark case", Reuters, 12/20/23
- "The New York Times sued Microsoft and OpenAI for alleged copyright infringement, touching off a legal fight over generative-AI technologies, with implications for the future of the news business", Alexandra Bruell, Wall Street Journal, 12/27/23
-- A related story (podcast) ➡ "How Adobe is managing the AI copyright dilemma, with general counsel Dana Rao", Nilay Patel, TheVerge, 1/9/24 - "F.C.C. Bans A.I.-Generated Robocalls", Cecilia Kang, NY Times, 2/8/24
-- This story also covered by NY Times, CNN, Forbes, NPR ... and the FCC - "Forced to Change: Tech Giants Bow to Global Onslaught of Rules", Adam Satariano and David McCabe, NY Times, 3/4/24
- "World’s Most Extensive AI Rules Approved in EU Despite Criticism", Jillian Deutsch, Bloomberg, 3/13/24
-- This story also covered by TechCrunch, BBC, Wall StreetJournal, VentureBeat, The Information, Mashable ... and European Parliament - "France Fines Google Amid A.I. Dispute With News Media", Adam Satariano, NY Times, 3/20/24
- "President Joe Biden to announce AI data center at failed Foxconn site in Wisconsin", Gaby Del Valle, The Verge, 5/8/24
-- This story also covered by Gizmodo, Reuters, Washington Post, NY Times,... and The White House - "Senators studied AI for a year. Critics call the result ‘pathetic.’", Cat Zakrzewski, Washington Post, 5/15/24
-- This story also covered by Engadget, The Verge, The Hill, Politico, NY Times, - "Senate committee passes three bills to safeguard elections from AI, months before Election Day", The Verge, Lauren Feiner, 5/15/24
H. Misc = Opinions, other news, rumors, long reads
- Two interviews with Demis Hassabis, CEO of Google DeepMind
-- "Inside Google’s big AI shuffle — and how it plans to stay competitive, with Google DeepMind CEO Demis Hassabis", Nilay Patel, The Verge, 7/10/23 ... audio and transcript of interview erge
-- "A.I. Could Solve Some of Humanity's Hardest Problems. It Already Has.". Guest = Demis Hassabis, The Ezra Klein Show (podcast with transcript), 7/11/23
- A trio NY Times audio interviews from Ezra Klein about generative AI.
-- 1. "How Should I Be Using A.I. Right Now?", Guest = Ethan Mollick (professor at the Wharton School of the University of Pennsylvania), Ezra Klein (NY Times podcast + transcript), 4/2/24
-- 2. "Will A.I. Break the Internet or Save It?", Guest = Nilay Patel (Editor of The Verge), Ezra Klein (NY Times podcast + transcript), 4/5/24
-- 3. "What if Dario Amodei is Right About A.I.", Guest = Dario Amodei (CEO of Anthropic), Ezra Klein (NY Times podcast + transcript), 4/12/24 - "The Atlas Robot Is Dead. Long Live the Atlas Robot", Carlton Reid, Wired, 4/17/24
-- YouTube videos ==> Old Atlas vs. New Atlas
-- This story also covered by Mashable, Engadget, VentureBeat, TechCrunch, - "‘To the Future’: Saudi Arabia Spends Big to Become an A.I. Superpower", Adam Satariano and Paul Mozur, NY Times, 4/25/24
- Big Tech quarterly reports ... Q1 (Jan Feb, Mar 2024)
-- "Alphabet Beats Revenue Estimates as AI Fuels Cloud Growth", Julia Love and Davey Alba, Bloomberg, 4/26/24
---- Alphabet Q1 also covered by Reuters, The Information, NY Times ... and Alphabet
-- "Microsoft Earnings Jump on AI Demand", Tom Dotan, Wall Street Journal, 4/26/24
---- Microsoft Q1 also covered by The Information, NY Times, ... and Microsoft
-- "Meta plunges 16% on weak revenue guidance even as first-quarter results top estimates", Ashley Capoot, CNBC, 4/24/24 ... Zuckerberg's "guidance" warned that Meta would be making huge AI capital investments in Q2
---- Meta Q1 also covered by Bloomberg, Business Insider, NY Times, ... and Meta
-- "Amazon Reports $143.3 Billion in Revenue for First Quarter of 2024", Karen Weise, NY Times, 4/30/24
---- Amazon Q1 also covered by Reuters, Bloomberg, The Information, Business Insider, ... and Amazon Q1
-- "Apple Sales Fall as iPhone, China Businesses Remain Sluggish", Aaron Tilley, Wall Street Journal, 5/2/24 .
-- Apple Q2 also covered by Business Insider, Reuters, Reuters AI .. and Apple Q2 (pdf) - Second (final?) thoughts about Rabbit's r1 Here are some reviews from techs who took a few more days to assess these products after others posted initial, more favorable impressions.
-- "Rabbit R1 review: A $199 AI toy that fails at almost everything", Devindra Hardawar, Engadget, 5/3/24
-- "Rabbit R1 review: I can't believe this bunny took my money", Kimberly Gedeon, Mashable, 5/3/24
-- "Turns out the Rabbit R1 was just an Android app all along", Allison Johnson, The Verge, 5/2/24... Not true!!! Not true!!! cries Rabbit CEO - "Google DeepMind debuts huge AlphaFold update and free proteomics-as-a-service web app", Devin Coldewey, TechCrunch, 5/8/24
-- This story also covered by The Verge, Wired, NY Times, VentureBeat, Engadget, Financial Times, ... and Google - "Everything Apple announced during its iPad event, including new OLED iPad Pro", Alex Perry, Mashable, 5/7/24 ... with M4 chipset
-- This story also covered by The Verge, Macworld, ... and Apple - "75% of Knowledge Workers Use AI on the Job, but Executives Are Dragging Their Feet", Lisa Lacy, CNET, 5/8/24
-- This story also covered by Wired, The Verge, Axios, CNBC, Fast Company, Fortune, ... and Microsoft and LinkedIn
I. Language model flaws, hacks, and remedies
- "The Security Hole at the Heart of ChatGPT and Bing", Matt Burgess, Wired, 5/25/23
-- Prompt-injection hack for plugins covered by Mashable - "Computer scientists claim to have discovered ‘unlimited’ ways to jailbreak ChatGPT", Clint Rainey, FastCompany, 7/27/23
-- This story also covered by NY Times, Mashable, Yahoo Finance, Wired, ZDNet,
-- Note: The research reported in these articles was conducted by Carnegie Mellon University - "Stanford study challenges assumptions about language models: Larger context doesn’t mean better understanding", Matt Marshall, VentureBeat, 7/21/23
- "Hackers Trick AI With ‘Bad Math’ to Expose Flaws and Biases", Katrina Manson, Bloomberg, 8/12/23
-- This story also covered by the NY Times - "Uh-oh! Fine-tuning LLMs compromises their safety, study finds", Ben Dickson, VentureBeat, 10/13/23
- "Patronus AI finds ‘alarming’ safety gaps in leading AI systems", Michael Nuñez, VentureBeat, 12/19/23
- "Anthropic researchers find that AI models can be trained to deceive", Emilia David, TechCrunch, 1/13/24
-- This story also covered by VentureBeat ... and Anthropic - "OpenAI's GPT Is a Recruiter's Dream Tool. Tests Show There's Racial Bias", Leon Yin, Davey Alba and Leonardo Nicoletti, TechCrunch, 3/7/24
- "Why Two Models Are Better Than One", Stephanie Palazzolo, The Information, 3/28/24
- "Many-shot jailbreaking", Anthropic, 4/2/24
-- This story also covered by video on TechCrunch, - "Measuring the Persuasiveness of Language Models", Anthropic, 4/9/24
J. Basics
- "Watch an A.I. Learn to Write by Reading Nothing but Shakespeare or Harry Potter or Jane Austen or Star Trek or Moby Dick", Aatish Bhatia, NY Times, 4/27/23
- "What Is a Large Language Model, the Tech Behind ChatGPT?", Kurt Muehmel, Data Iku, 6/7/23
- "Textbooks Are All You Need II: phi-1.5 technical report", Yuanzhi Li, Sébastien Bubeck, Ronen Eldan, Allie Del Giorno, Suriya Gunasekar, Yin Tat Lee, Microsoft Research, September 2023
- "Phi-2: The surprising power of small language models", Mojan Javaheripi and Sébastien Bubeck , Microsoft Research, 12/12/24
- WTF are diffusion transformers
-- "Stable Diffusion 3.0 debuts new diffusion transformation architecture to reinvent text-to-image gen AI", Sean Michael Kerner, VentureBeat, 2/22/24
-- "Diffusion transformers are the key behind OpenAI’s Sora — and they’re set to upend GenAI", Kyle Wiggers, TechCrunch, 2/28/24
-- "Diffusion Transformer Explained", Mario Namtao Shianti Larcher, Towards Data Science, 2/28/24 - "Compact Guide to Large Language Models", DataBricks, 2023 ... Link to form that enables download of their eBook (9 pages) pdf file.
- "Large language models can do jaw-dropping things. But nobody knows exactly why.", Will Douglas Heaven, MIT Tech Review, 3/4/24
- Dozen Basic AI FAQs
This page contains links to responses by Google's Bard chatbot to 12 questions that should be asked more frequently, but aren't. - "Let's learn about artificial intelligence -- A series about AI, machine learning, ChatGPT, and more", Mark Wiemer, Medium, 3/21/23
___________________________________
Links to some back issues
- Back issues ...
29 Mar 24, 1 May 24,
22 Feb 24, 29 Jan2 4, 1 Jan 24, PreBigBang,
6 Oct 23, 27 Aug 23, 18 July 23, 22 June 23,
16 May 23, 5 April 23, 28 Mar 23
No comments:
Post a Comment
Your comments will be greatly appreciated ... Or just click the "Like" button above the comments section if you enjoyed this blog note.