Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Conversation

dkurt
Copy link
Member

@dkurt dkurt commented Aug 4, 2023

Pull Request Readiness Checklist

As the results:

TODO:

  • Fix CUDA
  • Check fast_forward_ocl
  • Test LayerNorm + BatchNorm (input scales + fused scales)

See details at https://github.com/opencv/opencv/wiki/How_to_contribute#making-a-good-pull-request

  • I agree to contribute to the project under Apache 2 License.
  • To the best of my knowledge, the proposed patch is not based on a code under GPL or another license that is incompatible with OpenCV
  • The PR is proposed to the proper branch
  • There is a reference to the original bug report and related work
  • There is accuracy test, performance test and test data in opencv_extra repository, if applicable
    Patch to opencv_extra has the same branch name.
  • The feature is well documented and sample code can be built with the project CMake

@fengyuentau
Copy link
Member

There are some other backends that needs a dedicated layer norm implementation: #23550. Maybe a workaround is adding a flag in mvn indicating it is layer norm or others.

The name MVN is also confusing. What is it for?

@dkurt
Copy link
Member Author

dkurt commented Aug 4, 2023

The name MVN is also confusing. What is it for?

Mean Variance Normalization. Initially from Caffe.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants