Introducing GitHub Models: A new generation of AI engineers building on GitHub

From the early days of the home computer, the dominant mode of creation for developers has long been building, customizing, and deploying software with code. Today, in the age of AI, a secondary and equally important mode of creation is rapidly emerging: the ability to leverage machine learning models. Increasingly, developers are building generative AI applications where the full stack contains backend and frontend code plus one or more models. But a vast segment of developers still lack easy access to open and closed models. This changes today.

We are launching GitHub Models, enabling our more than 100 million developers to become AI engineers and build with industry-leading AI models.

From Llama 3.1, to GPT-4o and GPT-4o mini, to Phi 3 or Mistral Large 2, you can access each model via a built-in playground that lets you test different prompts and model parameters, for free, right in GitHub. And if you like what you’re seeing on the playground, we’ve created a glide path to bring the models to your developer environment in Codespaces and VS Code. And once you are ready to go to production, Azure AI offers built-in responsible AI, enterprise-grade security & data privacy, and global availability, with provisioned throughput and availability in over 25 Azure regions for some models. It’s never been easier to develop and run your AI application.

The joy begins in the model playground on GitHub

For most of us, learning to be a developer didn’t happen on a linear path in the classroom. It took practicing, playing around, and learning through experimentation. The same is true today for AI models. In the new interactive model playground, students, hobbyists, startups, and more can explore the most popular private and open models from Meta, Mistral, Azure OpenAI Service, Microsoft, and others with just a few clicks and keystrokes. Experiment, compare, test, and deploy AI applications right where you manage your source code.

In alignment with GitHub and Microsoft’s continued commitment to privacy and security, no prompts or outputs in GitHub Models will be shared with model providers, nor used to train or improve the models.

Test and compare different models

Every piece of software is unique. And likewise, every model is unique in its capabilities, performance, and cost. Mistral offers low latency, while GPT-4o is excellent at building multimodal applications that might demand audio, vision, and text in real time. Some advanced scenarios might require the integration of different modes, such as an embeddings model for Retrieval Augmented Generation (RAG).

With the suite of models, developers will have all the options they need to stay in the flow, experiment more, and learn faster than ever before. And this is just the first wave. In the months ahead, as we approach the general availability of GitHub Models, we will continue to add more language, vision, and other models to our platform.

Spin up Codespaces to bring your ideas to life

The fun doesn’t just stay in the playground. With the power of Codespaces, we’ve created a zero-friction path for you to experiment with the model inference code before dropping it into your own project. With sample code for a variety of languages and frameworks of all types ready to go, you can try out various scenarios without ever hitting “works on my machine” problems.

Then, once you’re ready, it’s a breeze to get things running in your project. Use the knowledge you’ve gained from the playground and Codespaces to set up a prototype or proof-of-concept within your own applications. Run prompt evals in GitHub Actions with a series of JSON files that you just pipe in the GitHub Models command within the GitHub CLI. Or you can leverage GitHub Models to build a GitHub Copilot Extension, extending GitHub’s platform ecosystem for every stage of software development. And finally, go to production with Azure AI by replacing your GitHub personal access token with an Azure subscription and credential.

As an AI startup founder and open source maintainer, GitHub Models enables my team to access and experiment with various LLMs in one place. This streamlines our development and lowers the entry barrier for building AI apps.

- Anand Chowdhary // Co-founder, FirstQuadrant

The creator network for the age of AI

From the creation of AI through open source collaboration, to the creation of software with the power of AI, to enabling the rise of the AI engineer with GitHub Models – GitHub is the creator network for the age of AI.

The path to artificial general intelligence (AGI) will not be built without the source code and collaboration of the interconnected community on GitHub. Just in the last year, more than 100K generative AI projects were created on GitHub.

GitHub Copilot is foundationally changing the speed of software production, already writing nearly 50% of code in files where it’s enabled. With GitHub Copilot Workspace, we envision a world where millions of novice, hobbyist, and professional developers alike can code with entirely human language.

And now with GitHub Models, more than 100 million developers can access and experiment with new AI models where they already manage their source code, issues, pull requests, workflows, and repositories – directly on GitHub.

In the years ahead, we will continue to democratize access to AI technologies to generate a groundswell of one billion developers. By doing so, we will enable 10% of the world’s population to build and advance breakthroughs that will accelerate human progress for all.

Today, we begin the limited public beta for GitHub Models. Get started now. We can’t wait to see what you will build from here.