Thanks to visit codestin.com
Credit goes to github.com

Skip to content

nickjlamb/PosterLens

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

PosterLens

PosterLens is an iOS application that uses computer vision and AI to extract and analyze text from scientific posters, helping users quickly understand complex research.

Key Features

  • Scientific Poster Scanning: Capture images of research posters with automatic edge detection
  • Text Extraction: Use OCR to read and process poster contents
  • AI-powered Summaries: Generate structured summaries via OpenAI GPT-3.5
  • Interactive Chat: Ask specific questions about the poster content with AI-generated contextual responses
  • Related Research Discovery: Find similar PubMed papers using Perplexity Search API
  • Smart Categorisation: Automatic research category detection with color-coded tags
  • Author Questions: Automatically generate insightful questions to ask the poster presenter
  • Scan History: Save and organize multiple poster scans with category filtering
  • Export Functionality: Share or save information as PDF

Technology Stack

  • Swift & SwiftUI: Modern UI framework for iOS
  • AVFoundation: Camera handling and image capture
  • Vision Framework: On-device text recognition and extraction
  • OpenAI API: AI-powered summarization and chat (GPT-3.5-turbo)
  • Perplexity Search API: Related research discovery with domain filtering
  • PubMed E-Utilities API: Citation validation and enrichment
  • PDFKit: PDF generation for exports

Architecture

PosterLens follows the MVVM (Model-View-ViewModel) architecture pattern. See PosterLens/ARCHITECTURE.md for more details.

Installation

For setup and installation instructions, see PosterLens/INSTALLATION.md.

API Pipeline

PosterLens uses a 4-stage API pipeline to transform poster photos into interactive insights. See PosterLens/API_PIPELINE.md for the complete technical documentation.

Documentation

Project Status

Featured in the Perplexity AI Cookbook.

Available on the App Store.

License

See the LICENSE file for full terms.

About

iOS app that scans scientific posters and generates AI summaries using Perplexity API and BigQuery

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •