Github models - add to category (#9820)

categories/artificial-intelligence/rules-to-better-ai-development.md

@@ -10,6 +10,7 @@ index:
 - use-system-prompt
 - use-semantic-kernel
 - evaluate-slms-vs-azure-cloud-llms
+- choosing-large-language-models
 - write-integration-tests-for-llm-prompts
 - website-chatbot
 - leverage-chatgpt

rules/choosing-large-language-models/rule.md

@@ -1,6 +1,5 @@
 ---
 type: rule
-tips: ""
 title: Do You Pick The Best Large Language Model For Your Project?
 seoDescription: When choosing an AI model for your application, it's crucial to
   try out different Large Language Models (LLMs) before committing. Learn how to
@@ -29,6 +28,10 @@ Because different LLMs are good at different things, it's essential to test them
 
 <!--endintro-->
 
+`youtube: https://www.youtube.com/embed/iXmf6UDo404?si=LjRyiaygh28dhVlV`
+**Video: Choosing the Right AI Model? GitHub Models Makes It Easy! | Isaac Lombard & Caleb Williams | Rules
+ (3 min)**
+
 ## Challenges in Implementing AI
 
 * **Decision fatigue** - there's  an overwhelming number of Language Models to choose from.
@@ -44,35 +47,34 @@ These platforms simplify testing and deploying different AI models from a variet
 
 #### [Azure AI Foundry](https://ai.azure.com/) (⭐Recommended for production)
 
-- Provides access to a variety of foundation models from different providers.
-- Allows side-by-side evaluation of models within the Azure ecosystem.
-- Enables fine-tuning and optimization for specific business needs.
+* Provides access to a variety of foundation models from different providers.
+* Allows side-by-side evaluation of models within the Azure ecosystem.
+* Enables fine-tuning and optimization for specific business needs.
 
 #### [GitHub Models](https://github.com/marketplace/models) (⭐Recommended for development)
 
-- **Free offering, rate-limited for development purposes.**
-- Easy Model Switching – Change models with a single API parameter using the Azure AI Inference library.
-- Flexible Model Choices – Select larger models for power or compressed models for efficiency.
-- Broad Ecosystem – GitHub Models simplifies testing and selecting the best LLMs.
-- Available models include models from...
+* **Free offering, rate-limited for development purposes.**
+* Easy Model Switching – Change models with a single API parameter using the Azure AI Inference library.
+* Flexible Model Choices – Select larger models for power or compressed models for efficiency.
+* Broad Ecosystem – GitHub Models simplifies testing and selecting the best LLMs.
+* Available models include models from...
   * OpenAI (GPTs)
   * Microsoft (Phi)
   * Meta (Llama)
   * and more...
 
 #### [AWS SageMaker AI](https://aws.amazon.com/sagemaker/)
 
-- Supports training, deploying, and managing LLMs at scale.
-- Offers built-in model evaluation and cost management features.
-- Enables model fine-tuning and hosting for enterprise AI solutions.
+* Supports training, deploying, and managing LLMs at scale.
+* Offers built-in model evaluation and cost management features.
+* Enables model fine-tuning and hosting for enterprise AI solutions.
 
 ## Other Tools to Compare Models
 
 ##### [GroqCloud Playground](https://console.groq.com/playground)
 
-- Free, rate-limited API and browser tool.
-- Provides a low-latency inference environment for running various LLMs.
-
+* Free, rate-limited API and browser tool.
+* Provides a low-latency inference environment for running various LLMs.
 
 ##### **[OpenAI Playground](https://platform.openai.com/playground/chat?models=gpt-4o)**
 
@@ -84,15 +86,13 @@ Self-hosted offering. No additional costs for using the language model. High har
 
 ## Using GitHub Models as a Development Tool
 
-`youtube: https://www.youtube.com/embed/iXmf6UDo404?si=LjRyiaygh28dhVlV`
-**Video: Choosing the Right AI Model? GitHub Models Makes It Easy! | Isaac Lombard & Caleb Williams | Rules
- (3 min)**
+![Figure: GitHub Models makes life easy](https://github.com/user-attachments/assets/f8fdca43-fd0c-4a16-a37d-b1d322752712)
 
 GitHub Models provides you with a free, rate-limited key you can use for practical tests in your application during development.
 
 GitHub Models supports a large amount of language models within the same ecosystem. The development cost of switching from one model to another is minimal, assuming you're using the Azure AI Inference API. Switching from one model to another is as simple as changing an API parameter. Your code implementation can stay the same.
 
-You have the option to choose between most major language models. You can experiment by submitting prompts to find the best fit for your scenario. 
+You have the option to choose between most major language models. You can experiment by submitting prompts to find the best fit for your scenario.
 
 For example, you may be building a chatbot and find that GPT 4o mini provides suitable responses and that you don't need to invest in the extra compute costs involved with running a larger model.
 
@@ -104,3 +104,7 @@ Once you've identified the best model for your needs, GitHub Models simplifies d
 2. Start incurring costs **only when you go live**.
 
 This approach allows you to make an informed decision before committing financially, ensuring you're using the right AI model for your application.
+
+In effect, GitHub Models is the lite version of Azure's AI Foundry – it can even use the same API.
+
+Can you see yourself trying GitHub Models out? Why or why not?