📸Snap2Chat (iOS Shortcut): Instantly Chat with AI About Any Screenshot

🛠️ Installation & Setup

Prerequisites:

• An OpenAI API key (click here to get one).

Installation Steps:

1. Download the Shortcut:
   • Install Snap2Chat
2. Configure the API Key:
   • Open the Shortcuts app.
   • Locate Snap2Chat and tap the three dots (...) to edit.
   • Find the section labeled "OpenAI API Key" and input your key.

Set Up Trigger Method:

1. Action Button (for iPhone 15 Pro and iPhone 15 Pro Max):
   • Go to Settings > Action Button.
   • Set the Action Button to trigger the Snap2Chat shortcut.
2. Double-Tap Back (for other iPhone models):
   • Go to Settings > Accessibility > Touch > Back Tap.
   • Choose "Double Tap" and select the Snap2Chat shortcut from the list.

💡 How It Works

1. Trigger the Shortcut using your chosen method.
2. Snap2Chat captures a screenshot of your current screen.
3. The image is sent to GPT-4.1, which processes and understands the visual content.
4. Engage in a chat with AI to ask questions or get explanations about the screenshot.

🎯 Use Cases

Snap2Chat is designed to help you make sense of the world around you—visually. Here are some examples of what you can ask the AI after capturing a screenshot:

• Education:
  • "What does this diagram mean?"
  • "Summarize this Wikipedia page."
  • "Explain this math problem."
• Work:
  • "What is this dashboard telling me?"
  • "Summarize this Slack thread."
  • "Help me understand this code snippet."
• Everyday Use:
  • "What is this dish in the photo?"
  • "Translate this menu from Japanese."
  • "What’s the main point of this tweet?"
  • "Give me a TL;DR of this news article."

💎 Bonus

You could easily tweak this shortcuts to support image caption through camera