Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Conversation

@CloseChoice
Copy link
Collaborator

Overview

Closes #3589

Description of the changes proposed in this pull request:

  • the falcon model does not need position_ids so we check the function signature dynamically now and only hand over the expected arguments to avoid errors
  • add test with tiny falcon model (<10MB). Admittedly we can improve what we test but this test works for now. Fails on master but works on this branch.

Checklist

  • All pre-commit checks pass.
  • Unit tests added (if fixing a bug or adding a new feature)

@CloseChoice CloseChoice requested a review from connortann March 25, 2024 23:11
Copy link
Collaborator

@connortann connortann left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks great. Apologies for the rather slow response - I've been away for most of the past week.

I'll rename the title to something a bit more descriptive, to help the release notes.

Copy link
Collaborator

@connortann connortann left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pending tests passing

@connortann connortann changed the title fix falcon Fix use of Falcon language model for text generation Mar 28, 2024
@connortann connortann added the bug Indicates an unexpected problem or unintended behaviour label Mar 28, 2024
@CloseChoice CloseChoice requested a review from connortann April 2, 2024 21:25
@codecov
Copy link

codecov bot commented Apr 2, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 61.66%. Comparing base (70ef03b) to head (a90fdbc).
Report is 5 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #3592      +/-   ##
==========================================
+ Coverage   61.54%   61.66%   +0.11%     
==========================================
  Files          90       90              
  Lines       12717    12721       +4     
==========================================
+ Hits         7827     7844      +17     
+ Misses       4890     4877      -13     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Collaborator

@connortann connortann left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Looks like a test failed due to a dependency install issue, which might be a transient network issue. I've retriggered that job, hopefully it will pass.

@connortann connortann merged commit bbbe821 into shap:master Apr 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Indicates an unexpected problem or unintended behaviour

Projects

None yet

Development

Successfully merging this pull request may close these issues.

BUG: Error using Falcon for text-generation

2 participants