OpenAI has announced Plugin support for ChatGPT. Plugins will let ChatGPT users access data from knowledge sources, code, the world wide web and other sources.
OpenAI Plugin support for ChatGPT will also improve the performance of the platform’s language model.
ChatGPT can now access third-party services, up-to-date information, and perform computations.
OpenAI will roll out the plugins feature and collect feedback to improve the offering.
Plugins will Enhance ChatGPT Capabilities
Plugins make it easier for developers and users to discover more ways to use ChatGPT.
The large Language Model relies on training data. Plugins can work as their way to expand access to more information, including personal and recent updates.
The focus is still on making AI better for users.
OpenAI is going to open-source code for retrieval plugin. This will allow developers to use ChatGPT in their way.
Two ChatGPT plugins: Code Interpreter and Web Browser have been revealed.
ChatGPT Plugins: Web Browsing [alpha]
We’re constantly experimenting and innovating with our models, and we’re excited to share that we’ve developed an experimental model that knows how to browse the internet!
We’ve been inspired by some of our past work (including WebGPT, GopherCite, BlenderBot2, LaMDA2, and others) that have allowed language models to read information from the internet. This expands the amount of content our models can discuss, going beyond their training corpus to include fresh information from the present day.
Let us give you an example of the kind of experience that browsing opens up to ChatGPT users. Previously, the model may have politely pointed out that it didn’t have enough information to answer a question. But now, with our browsing feature, ChatGPT can retrieve recent information about the latest Oscars and even perform its now-famous poetry feats!
Browsing is just one way that we’re enhancing the ChatGPT experience, and we can’t wait for you to try it out and discover all the other additive experiences it brings to the table!
ChatGPT Plugins: Code Interpreter [alpha]
ChatGPT now has an experimental ChatGPT model that can use Python and handle uploads and downloads. The Code interpreter now:
- Has access to a working Python interpreter in a sandboxed, firewalled execution environment.
- Eevaluates code in a persistent session that lasts throughout the chat conversation, with a maximum timeout.
- Includes subsequent call capabilities that can build on top of each other.
- Allows users to upload files to the current conversation workspace.
- Also enables downloading of the results of your work.
We’re excited to share that ChatGPT has developed some pretty impressive programming skills to make coding even more natural and intuitive. Imagine having programming assistant at your fingertips to help you manage your development workflow.
Initial studies have shown that using a code interpreter can be especially useful for
- solving mathematical problems (both quantitative and qualitative),
- doing data analysis and visualization, and
- converting files between formats.
But we also invite you to try it out for yourself and discover other useful tasks!
The OpenAI Retrieval Plugin
If you’re looking to enhance your experience with ChatGPT and access personal or organizational information sources (with permission, of course!), you’ll definitely want to check out the open-source retrieval plugin.
This plugin allows users to easily obtain the most relevant document snippets from their data sources, such as files, notes, emails, or public documentation, just by asking questions or expressing their needs in natural language. It’s a game-changer!
Developers can also deploy their own version of the plugin and register it with ChatGPT as an open-source and self-hosted solution. With the power of OpenAI embeddings and the ability to choose from a variety of vector databases (Milvus, Pinecone, Qdrant, Redis, Weaviate, or Zilliz) for indexing and searching documents, the possibilities are endless. Plus, information sources can be easily synchronized with the database using webhooks.
Ready to get started? Head over to the retrieval plugin repository to learn more!
OpenAI Allow Third Party Plugins
With Plugins support ChatGPT will easily integrate with third-party apps. This will help the ChatGPT become better in a faster way.
With third-party plugins, ChatGPT will perform many unusual tasks, such as:
Perform certain actions on user request, such as ordering food or booking flight tickets.
Access real-life-information such as the latest updates, sports, stock markets, etc.
Fetch Knowledge base data from personal notes and company documents.
OpenAI has revealed a list of platforms that will have Plugins for ChatGPT:
- Expedia
- Kayak
- OpenTable
- Wolfram
- FiscalNote
- Kiarna Shopping
- Shop
- Zapier
- Instacart
- Milo Family AI
- Speak
How do I get access to ChatGPT Plugins?
If you want access to ChatGPT plugins on the platform, join the ChatGPT Plugins waitlist.
Select developers and ChatGPT Plus users will have access to the new ChatGPT plugins once the feature is fully launched. Plugins will become available for a wider user base at a later date.
Summary of Benefits of ChatGPT Plugins
OpenAI plugin support for ChatGPT will open the door for more creativity, monetization and traffic opportunities for both developers and users.
Current plugins include retrieval plugins, browsing plugins, and code interpreter plugins.
Follow my posts on LinkedIN
