I tested Gemini Advanced, ChatGPT, and Copilot Pro Heres which AI searched best

The update lets you create detailed visuals directly within Microsoft 365 applications, including Word, Excel and Outlook, by simply describing your desired image. In a direct comparison as AI tools, ChatGPT’s multi-purpose capabilities and wider range of use cases give it a clear edge over GitHub Copilot. It goes beyond coding, handling writing, research, and productivity tasks. It thrives in IDEs, offering real-time assistance that streamlines coding tasks without distraction. Tabnine is an AI coding assistant that delivers real-time code completions, trained on open-source code with permissive licenses.

Alternatives to GitHub Copilot or ChatGPT

In return, Pichai wants Gemini to be used by 500 million people by the end of 2025, sources familiar with the matter told the WSJ. Google itself hasn’t revealed how many people currently use Gemini, the WSJ said. A December 2024 report said that Gemini averaged almost 275 million monthly visits by the end of the year. Though that was up from 270 million monthly visits in August 2024 and 271 million in July 2024, it was down from 292 million in October.

Gemini Code Assist

Claude AI, developed by Anthropic, is designed to excel in brainstorming, creative writing, and strategic thinking. Its human-like interaction style creates a natural and engaging user experience, making it particularly appealing for tasks that require a personal touch. With a large context window of 200,000 tokens, Claude is well-suited for managing complex projects, analyzing lengthy documents, and generating innovative ideas.

reasons why I still prefer Perplexity over every other AI chatbot

For the sake of gauging their coding capabilities and effectiveness, I tested both GitHub Copilot and ChatGPT with prompts related to coding. The side panel works well across Gmail, Drive, and Docs, and it’s handy for pulling in context from whatever you’re working on. Visually, it looks clean and modern, with a color scheme that gives it a polished, almost elegant feel.

Things get even more bleak for Copilot when you realize how many of its users are likely to be using it only because it’s the tool built into their computer by default. I performed all these tests on the free version of both platforms, as that’s how the majority of users will experience them. If you’re one of the people paying $200 a month for the most premium version of ChatGPT, for example, your experience will differ from these results. Two, I used the main chat function for each test unless otherwise stated.

What is the Microsoft Copilot AI assistant?

The Creative mode came the closest to ChatGPT’s default behavior in my experience and as you can see in the screenshot above. Even so, ChatGPT tends to provide longer responses which some may actually prefer. A GitHub Copilot subscription costs $10 per month, or $100 per year when billed annually, although businesses must pay $19 per user per month. Of these all, Github Copilot is the odd one out, as it’s functions aren’t anchored in the same “foundational LLMs” that the other tools rely on. On Windows 11, Copilot has appeared since late September as a button that you can click to pull up a righthand sidebar that hosts the chatbot. Common wisdom dictates that writers should have their own websites, but I’ve been putting off the creation of one.

GitHub Copilot, while offering transparent and straightforward pricing, is more limited in structure compared to ChatGPT. Its free plan includes 2,000 code completions and 50 chat messages per month. For users requiring more extensive usage, Copilot Pro is available at $10 per month or $100 per year, offering unlimited code completions and additional features. GitHub Copilot and ChatGPT are leading AI tools built on OpenAI models, each serving a different purpose.

I asked both how my local hockey team, the Colorado Avalanche, are doing this season, and both gave me an overview that appears to be correct. Both ChatGPT and Copilot provided me with current rankings and a few highlights from the season, but ChatGPT was more detailed. It’s interesting to see how both AIs repeat phrases here, such as “on the rise” and “lights/guides the way.” I’d guess that Copilot defaults to ChatGPT for this, and that’s why the poems are similar. Neither poem was particularly beautiful or evocative, but both bots passed this test, and both showed a basic understanding of what SlashGear is, which was integral to the prompt.

Users have already done some amazing things with it, including programming an entire 3D space runner game from scratch. ChatGPT is built on GPT-4o, a robust LLM (Large Language Model) that produces some impressive natural language conversations. Based on the existing state-of-the-art GPT-4 family, 4o is trained from the ground up as a multimodal model making it far more computationally efficient to operate. However, the apps are otherwise nearly carbon copies of their web interfaces. Both apps are essentially just wrappers for that interface, since it’s not as if your phone has the power to run these models locally. Unless you’re very excited to hear a robot read the news to you, the ChatGPT app is the better option simply because ChatGPT has more built in features within its interface.

• So, I spent time using each AI assistant’s interface to see how smooth, intuitive, and helpful the overall experience felt.
• ChatGPT takes the lead in customer support because of its multiple support channels.
• When I asked, “What’s the latest on the investigation into Gene Hackman,” Copilot gave me the basics of the story and told me autopsy and toxicology tests are still pending.
• However, both the GPT-3.5 and GPT-4 models only use data from prior to September 2021, meaning that current news stories won’t be in the mix.

It also included source links under each paragraph (that worked when testing this), making it easy to double-check the info. I also liked that when the cursor hovered over the source link, it would highlight the text it got from that source. Yes, you can access Bing Chat using Google’s Chrome web browser but you will lose out on some features like chat history. We have also seen response limitations per conversation, but Microsoft has loosened that restriction of late. The company once said that most people find what they’re looking for within five replies or fewer. On that note, it’s important to not completely trust either chatbot as both ChatGPT and Copilot are susceptible to “hallucinating”.

ChatGPT vs Copilot: Limitations and pricing

So, I gave each chatbot a few fact-based prompts to see how accurate they were and whether they flagged uncertainties, something they all passed with flying colors. With AI chatbots now built into search engines, browsers, and even your desktop, it’s easy to assume they all do the same thing. But when it comes to getting useful search results, some outperform the rest. For example, you can use either chatbot while shopping to compare the pros and cons of newly-released products or to prepare a personalized itinerary for your next vacation. Both of these tasks require a fair amount of web-based research, which will take you far longer to do manually. The large language models (LLM) behind ChatGPT were trained on a vast range of data publically available on the internet, scraping everything from artists’ oeuvres to entire libraries and news archives.

In contrast, GitHub Copilot only provides direct email support to paid users. Free users only have access to self-help options like documentation and community forums, which may not be sufficient for resolving more complex issues. It can help with coding through third-party plugins for IDEs and can generate useful content for CI/CD, testing, and Git workflows — but none of these are officially integrated. This means it’s more flexible in what it can talk about, but less connected to the actual tools developers use every day. Both ChatGPT and GitHub Copilot perform exceptionally well when it comes to understanding different prompt styles.