UsefulAINewsBackup20Nov24


--
Last update: Wednesday 11/20/24
Our weekly news page provides links to reports about major innovations in generative AI. Our page is not for AI experts. It's for (1) computer savvy professionals who want to be alert to genAI's potential impact on their careers, and (2) computer savvy citizens who want to be alert to genAI's potential impact on our society.

Most of the links on this page refer to reports published after the "AI Big Bang", i.e., after Sam Altman's sudden firing and rapid rehiring by OpenAI, i.e., after November 20, 2023. The previous edition of this page can be found here ➡ PreBigBang  

A. OpenAI  | B. Microsoft | C.  Google | D. Other Models | E. Agents | 
F. SLM News | G. Public Policy  | H. OpEds+Misc | I. Hacks | J. Basics

Top story 3 stories in past week ... 

... Upcoming events

Evolving context and connections ... 
Fast moving AI news is often exciting, but also confusing. This page is designed to provide readers with an evolving context for the news and reminders of the connections between news items. From time to time, links to older stories whose content has been overcome by newer events will be deleted. However, enough older links will be retained so that readers can get a quick sense of how we got to where we are today by skimming the headlines of the preceding stories in chronological order. No section will ever include more than 12 stories.
 ➡ Our publication schedule

A. OpenAI
  • "OpenAI CTO Mira Murati Is Leaving the Company", Paresh Dave and Will Knight, Wired, 9/25/24  
    --     This story also coverred by The Verge, Gizmodo, Engadget, Bloomberg, TechCrunch
     -- Note that some observers don't believe the departure by Murati and other long-time staffers will diminish the VC community's investments in OpenAi, e.g., "OpenAI’s Investors Are Hanging On For the Ride", Kate Clark, The Information, 9/27/24

  • "OpenAI’s DevDay brings Realtime API and other treats for AI app developers", Maxwell Zeff, TechCrunch, 10/1/24  
    -- This story also covered by VentureBeat, Ars Technica, Axios, ... and OpenAI
    -- Also see our special edition TL;DR + Podcast

  • "OpenAI just raised $6.6 billion to build ever-larger AI models", Kylie Robison, The Verge, 10/2/24 
    -- This story also covered by TechCrunch, Wall Street Journal, Bloomberg, ... and OpenAI
    -- Here's a related story: "OpenAI also secured a massive credit line", Connie Loizos, TechCrunch, 10/3/24 ... Also covered by Engadget

  • "OpenAI’s ChatGPT Breaks Out of Its Box—and Onto a Canvas", Reece Rogers, Wired, 10/3/24 
    -- This story also covered by TechCrunch, VentureBeat, ... and OpenAI

  • "OpenAI says it won’t release a model called Orion this year", Kyle Wiggers, TechCrunch, 10/25/24
    -- This story also covered by  VentureBeat

  • OpenAI folds SearchGPT (beta) into ChatGPT
    -- "OpenAI’s search engine is now live in ChatGPT ", Kylie Robison, The Verge, 10/31/24 
    ... This story also covered by The Verge, Wired, Gizmodo, TechCrunch, NY Times, VentureBeat, Engadget, Bloomberg, ... and  OpenAI

  • "OpenAI Shifts Strategy as Rate of ‘GPT’ AI Improvements Slows", Stephanie Palazzolo, Erin Woo ,and Amir Efrati, The Information, 11/9/24
B. Microsoft 
C. Google 

D. Amazon, Meta, Anthropic, Apple, and other Big Tech models

E. Agents ... new section
Editor's note -- This new section replaces the old "Large Lange Model News" section because, nowadays, all AI news is based on large language models ... except news about small models ithat will conntinue to be reported in the next section. Agents have been discussed for the last two years, but at this poine they seem to be on the verge of becoming a reality. Indeed, agents might become the hottest arena of competition for Big Tech AI producers, whose other developments will be covered in the preceding sections -- A, B, C, and D
  • "OpenAI’s Swarm AI agent framework: Routines and handoffs", Bryson Masse, VentureBeat, 10/14/24
    -- This story also covered by Computerworld

  • "Microsoft’s new AI agents set to shake up enterprise software, sparking new battle with Salesforce", Michael Nuñez, VentureBeat, 10/21/24

  • "Anthropic’s agentic Computer Use is giving people ‘superpowers", Taryn Plumb, VentureBeat, 10/24/24 
    -- This story also covered by Wired, TechCrunch, Bloomberg, Corbin Brown's demo (YouTube video) ... and Anthropic

  • Other recent announcements of agents 
    -- Salesforce (Bloomberg, Axios) ... and Salesforce
    -- Microsoft (Bloomberg, ZDNet) ... and Microsoft
    -- Google (The Verge, The Information)

  • "Gartner predicts AI agents will transform work, but disillusionment is growing", Taryn Plumb, VentureBeat. 10/28/24
  • "Microsoft’s agentic AI tool OmniParser rockets up the open source charts", Bryson Masse, VentureBeat, 10/31/24
  • "The great AI masquerade: When automation wears an agent costume", Pascal Bornet, VentureBeat, 10/31/24

  • "Microsoft’s new Magentic-One system directs multiple AI agents to complete user tasks", Emilia David, VentureBeat, 11/5/24
  • "Google Accidentally Reveals ‘Jarvis’ AI That Takes Over Computers", Erin Wooa and Stephanie Palazzolo, The Information, 11/5/24
    -- This story also covered by Endadget, Gizmodo

  • "You can now try out Microsoft’s new AI-powered Xbox chatbot", Tom Warren, The Verge, 11/4/24
  • "ChatGPT can now read some of your Mac’s desktop apps", Maxwell Zeff, TechCrunch, 11/14/24
    -- This story also covered by MacRumors, 9to5Mac, 
F. Small Language Model (SLM) news 
Editor's note -- News reports are classified in this category if and only if they explicitly refer to models with less than 70 billion (70B) parameters. The pace of development should heat up as small, fast models are hooked up to large models and as the competition to become the dominant self-contained AI model on smart phones intensifies.
  • "Europe’s largest seeded startup Mistral AI releases first model, outperforming Llama 2 13Bx", Shubham Sharma, VentureBeat, 9/27/23 ... Mistral 7B
    -- This story also covered by Mistral

  • "Microsoft releases Phi-2, a small language model AI that outperforms Llama 2, Mistral 7B", Carl Franzen, VentureBeat, 12/12/23 
    -- This story also covered by ZDNet, TechRepublic, Medium, Computerworld ... and Microsoft

  • "Allen Institute for AI releases ‘truly open source’  LLM to drive ‘critical shift’ in AI development", Sharon Goldman, VentureBeat, 2/1/24 ... OLMo 7B parameters
    -- This story also covered by TechCrunch ... and Allen Institute

  • "Google goes 'open AI'" with Gemma, a free, open-weights chatbot family", Benj Edwards, Ars Technica, 2/21/24 ...7B and 28B
    -- This story also covered by Reuters, Fast Company, Hugging Face, Fortune, NY Times ... and Google

  • "Generative AI and the big buzz about small language models", Clint Boulton, VentureBeat, 2/29/24

  • "Meta releases Llama 3, claims it’s among the best open models available", Kyle Wiggers, TechCrunch, 4/18/24 
    -- Meta's announcement of Llama 3 ➡ HERE
    -- Another Big Tech's opinion: "Elon Musk’s ‘not bad’ review thrusts Meta’s Llama 3 AI into spotlight", Michael Nuñez, VentureBeat, 4/19/24

  • "Microsoft Makes a New Push Into Smaller A.I. Systems", Karen Weise and Cade Metz, NY Times, 4/23/24  
    -- This story also covered by The Verge, Engadget, Ars Technica, ZDNet ... and AI Revolution YouTube Video... and Microsoft ➡ Microsoft benchmarks pdf

  • "Why Apple is taking a small-model approach to generative AI", Brian Heater, TechCrunch, 6/11/24  
    --     Apple's small language model strategy also discussed by VentureBeat, Wired, The Verge, ... and Apple (SLM) plus Apple ("private cloud compute" extension of SLM)

  • "Meta just beat Google and Apple in the race to put powerful AI on phones", Michael Nuñez, VentureBeat, 20/24/24
  • "Meta makes its MobileLLM open for researchers, posting full weights", Carl Franzen, VentureBeat, 10/31/24

G. Public policy and legal considerations  

H. Misc = Opinions, other news, rumors, long reads
  • "75% of Knowledge Workers Use AI on the Job, but Executives Are Dragging Their Feet", Lisa Lacy, CNET, 5/8/24 
    -- This story also covered by Wired, The Verge, Axios, CNBC, Fast Company, Fortune, ... and Microsoft and LinkedIn  

  • Has Big Tech over invested in GenAI? Are we in a bubble that's about to burst? 
    -- "Big Tech’s AI Promises Become a ‘Show Me’ Story For Investors", Carmen Reinicke, Bloomberg, 8/3/24
    -- "This Week in AI: Companies are growing skeptical of AI’s ROI", Kyle Wiggers, TechCrunch, 7/31/24
    -- "The Generative-AI Revolution May Be a Bubble", Matteo Wong, The Atlantic, 8/2/24
    -- "AI bubble: Tech stocks plummet with another potential 25% drop, analysts warn", Paolo Confino, Fortune, 8/2/24
    -- "Elliott says Nvidia is in a ‘bubble’ and AI is ‘overhyped’", Laurence Fletcher and Costas Mourselas, Financial Times, 8/2/24

  • "What Could Stop AI Scaling?", Org Charts, The Information, 8/20/24
          
  • "Hungry for Energy, Amazon, Google and Microsoft Turn to Nuclear Power", Ivan Penn and Karen Weise, NY Times, 10/16/24  
    -- This story also covered by VentureBeat, The Verge, Engadget, TechCrunch, BBC

  • "Microsoft and OpenAI’s Close Partnership Shows Signs of Fraying", Cade MetzMike Isaac and Erin Griffith, NY Times 10/17/24
  • "Nvidia overtakes Apple as world's most valuable company", Sruthi Shankar and Noel Randewich, Reuters, 10/25/24

  • Big Tech quarterly reports ... 
    -- Alphabet, "Wall St ends lower as megacaps highlight AI costs", Abigail Summerville, Reuters, 10/31/24  
    ... This story also covered by Forbes, NY Times, 

    -- Amazon, "Amazon Stock Climbs After a Big Earnings Beat. Spending Is Up Too.", Angela, Barron's, 11/1/24   
    ... This story also covered by Business Wire, GeekWire, 

    -- Apple, "Apple Sales Hit Quarterly Record as iPhone Business Rebounds", Aaron Tilley, Wall Street Journal, 10/31/24 
    ... This story also covered by Inveestors Business Daily, ... and Apple

    -- Meta, "Wall St ends lower as megacaps highlight AI costs", Abigail Summerville, Reuters, 10/31/24  
    ... This story also covered by Bloomberg, Wall Street Journal, NY Times, 

    -- Microsoft, "Microsoft Cloud revenue rises on AI boom but softer outlook weighs on shares", Stephen Morris, Financial Times, 10/31/24  
    ... This story also covered by GeekWire, NY Times, 

  • "Nvidia Will Replace Intel in the Dow Jones Stock Index", Kate Conger, NY Times, 11/1/24
    ... This story also covered by Business Insider, Reuters, 

  • Post-election predictions about the impact of Trump's victory on AI regulation
    -- Wired, "What Donald Trump's Win Will Mean for Big Tech", Lauren Goode, Paresh Dave, and Will Knight, 11/7/24
    -- TechCrunch, "What Trump’s victory could mean for AI regulation", Kyle Wiggers, 11/6/24
    -- The Verge, "What a second Trump presidency means for tech", Lauren Feiner,     11/8/24

  • "The other election night winner: Perplexity", Maxwell Zeff, TechCrunch, 11/6/24
    -- This story also covered by     Wired, The Verge, ZDNet ... and Perplexity

  • "Elon Musk targets Microsoft in amended OpenAI lawsuit", Jess Weatherbed, The Verge, 11/15/24
    -- This story also covered by Gizmodo, BBC, TechCrunch, NY Times, Business Insider, Wall Street Journal

  • "OpenAI and others seek new path to smarter AI as current methods hit limitations",  Krystal Hu and Anna Tong, Reuters, 11/15/24
    -- This story also covered by     Beebom, The Information

I.  Language model flaws, hacks, and remedies
  • "Computer scientists claim to have discovered ‘unlimited’ ways to jailbreak ChatGPT", Clint Rainey,  FastCompany, 7/27/23 
    -- This story also covered by  Mashable, Yahoo Finance, Wired, ZDNet, 
    -- Note: The research reported in these articles was conducted by Carnegie Mellon University  
  • "Hackers Trick AI With ‘Bad Math’ to Expose Flaws and Biases", Katrina Manson, Bloomberg, 8/12/23 
    -- This story also covered by the NY Times

  • "Patronus AI finds ‘alarming’ safety gaps in leading AI systems", Michael Nuñez, VentureBeat, 12/19/23
  • "Anthropic researchers find that AI models can be trained to deceive", Emilia David, TechCrunch, 1/13/24 
    -- This story also covered by     VentureBeat  ... and Anthropic 

  • "Why Two Models Are Better Than One", Stephanie Palazzolo, The Information, 3/28/24
  • "Many-shot jailbreaking", Anthropic, 4/2/24 
    -- This story also covered by video on TechCrunch, 

  • "Measuring the Persuasiveness of Language Models", Anthropic, 4/9/24
  • "DeepMind researchers discover impressive learning capabilities in long-context LLMs", Ben Dickson, VentureBeat, 4/24/24 

  • "[Gen] AI Is a Black Box. Anthropic Figured Out a Way to Look Inside", Steven Levy, Wired, 5/22/24
    -- This story also covered by Fast Company, NY Times, Time, ... and Anthropic

  • "OpenAI Offers a Peek Inside the Guts of ChatGPT", Will Knight, Wired, 6/6/24  
    -- This story also covered by OpenAI Blog Note ... and underlying OpenAI Research Paper (pdf)  co-authored by Dr. Ilya Sutskever and Jan Leike (before they resigned from OpenAI) and others on the recently disbanded “superalignment” team 

  • "A New Trick Could Block the Misuse of Open Source AI", Will Knight, Wired, 8/2/24

  • "MIT researchers release a repository of AI risks", Kyle Wiggers, TechCrunch, 8/14/24  
    -- This story also covered by VentureBeat, CSO, ZDNet, MIT Tech Review ... and AI Risk Repository

J. Basics 
  • "Watch an A.I. Learn to Write by Reading Nothing but Shakespeare or Harry Potter or Jane Austen or Star Trek or Moby Dick", Aatish Bhatia, NY Times, 4/27/23 
  • "What Is a Large Language Model, the Tech Behind ChatGPT?", Kurt Muehmel, Data Iku, 6/7/23 
  • "Textbooks Are All You Need II: phi-1.5 technical report", Yuanzhi Li, Sébastien Bubeck, Ronen Eldan, Allie Del Giorno, Suriya Gunasekar, Yin Tat Lee, Microsoft Research, September 2023

  • "Phi-2: The surprising power of small language models", Mojan Javaheripi and Sébastien Bubeck , Microsoft Research, 12/12/24
  • WTF are diffusion transformers 
    -- "Stable Diffusion 3.0 debuts new diffusion transformation architecture to reinvent text-to-image gen AI", Sean Michael Kerner, VentureBeat, 2/22/24
    -- "Diffusion transformers are the key behind OpenAI’s Sora — and they’re set to upend GenAI", Kyle Wiggers, TechCrunch, 2/28/24
    -- "Diffusion Transformer Explained", Mario Namtao Shianti Larcher, Towards Data Science, 2/28/24

  • "Compact Guide to Large Language Models", DataBricks, 2023 ... Link to form that enables download of their eBook (9 pages) pdf file.
  • "Large language models can do jaw-dropping things. But nobody knows exactly why.", Will Douglas Heaven, MIT Tech Review, 3/4/24
  • "Let's learn about artificial intelligence -- A series about AI, machine learning, ChatGPT, and more", Mark Wiemer, Medium, 3/21/23

  • "A Glossary for the AI Revolution", Seth Fiegerman and Nate Lanxon ... Illustrations by Mathieu Labrecque, Bloomberg, 10/4/24

___________________________________
Links to some back issues

No comments:

Post a Comment

Your comments will be greatly appreciated ... Or just click the "Like" button above the comments section if you enjoyed this blog note.

Subscribe to: Posts (Atom)