Dozen Basic AI FAQs

Last update: Friday 1/12/24 

This page contains links to responses by Google's Bard chatbot to 12 questions that should be asked more frequently, but aren't. As consequence, too many readily understood AI terms have become meaningless buzzwords in the media. 

The questions on this page are ordered by increasing specificity, so they should be read in numerical order. Most readers are less likely to understand Bard's answers to later questions if they haven't read its answers to questions that appear earlier in the list.

Read more ➡ HERE

Instructions ➡ Click the linked terms in each question to load Bard's response to the question

Question 1: What is artificial intelligence (AI) and what are its major subfields? 

Question 2: What is artificial general intelligence (AGI)?

Question 3: What is natural language processing and what are the most important developments in its history?

Question 4:  What is machine learning? How does it differ from rule-based learnng? Please provide examples

Question 5: What impact has machine learning had on natural language processing? Which kind of machine learning has had the largest impact?

Question 6:  What is a language model and what are the most important architectural structures for language models? Provide examples of recent language models that embody each architecture.

Question 7:  In the development of language models, what are emergent properties? 

Question 8: Generative language models can create original text, images, videos, sound, and code. What is done to language models to make them generative? And can small language models be generative?

Question 9:  Are all emergent properties of a model the result of its generativity?

Question 10: What are the most important emergent properties that have been exhibited by large language models?

Question 11:  What are the most important emergent properties that have been exhibited by small language models?

Question 12 via ChatGPT:  Please identify seven small language models that have less than 80 billion parameters that were released in 2022 or 2023. Note: Using ChatGPT because Bard (before Gemini Pro) unable to search Internet for recent content.

____________________________________

Links to related notes:  

• "The Rise of Small Language Models— Efficient & Customizable", Bijit Ghosh, Medium, 11/26/23
• "9 Best Small Language Models Released in 2023", Sandhra Jayan, AIM, 12/7/23
• "Small language models an emerging GenAI force", Antone Gonsalves, TechTarget, 12/15/23
• "Everything You Need to Know about Small Language Models (SLM) and its Applications", Tanya Malhotra, MarTechPost, 12/5/23
• "7 Steps to Running a Small Language Model on a Local CPU", Aryan Garg, KDnuggets, 11/14/23