Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Add Siglip2 (naflex) support #1402

@pySilver

Description

@pySilver

Model description

Hi! While most of the Siglip2 models are supported as they identify themselves as siglip there is a most popular model version: https://huggingface.co/google/siglip2-so400m-patch16-naflex which identifies itself as siglip2 (see https://huggingface.co/google/siglip2-so400m-patch16-naflex/blob/main/config.json).

Naflex version is a little bit different. They say:

A cherry on top is the dynamic resolution (naflex) variant. This is useful for downstream tasks sensitive to aspect ratio and resolution.

https://huggingface.co/blog/siglip2

Prerequisites

  • The model is supported in Transformers (i.e., listed here)
  • The model can be exported to ONNX with Optimum (i.e., listed here)

Additional information

No response

Your contribution

Unfortuantelly, I am not an expert in this field.

Metadata

Metadata

Assignees

No one assigned

    Labels

    new modelRequest a new model

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions