-
Notifications
You must be signed in to change notification settings - Fork 1.4k
Feat/tensorflow parser #501
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
…dnn#254) * necessary proto for parser weights and graph from TensorFlow * necessary proto for parser weights and graph from TensorFlow * tensor graph loader * clean unnecessary files * model generator of alexnet and squeezenet * nodes parser for inception and squeezenet model * applicble training for sqnet * value detail and training * value statistic in nodes and transformation to tiny-cnn initial * output all useful info in proto * clear representation * all values in protofiles could be deserialized * float Tensors bugfix * layer transfer * layer transfer * remove unmature api in example of pb parser * remove abundant codes * transforming to io * inline add and remove unnecessary messages
@edgarriba, thanks for your PR! By analyzing the history of the files in this pull request, we identified @beru, @nyanp and @wangyida to be potential reviewers. |
9ad8416
to
40516bb
Compare
40516bb
to
e8dc8c3
Compare
@wangyida I have some problems with *.proto file path since some of them depends on others. Any tip how we can easily fix it? |
#include <sstream> | ||
#include <string> | ||
#include <map> | ||
#include "tensorflow/core/framework/graph.pb.h" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This one is definetely doesn't exists
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
it's supposed that's generated during the cmake configuration by the proto compiler
#include <sstream> | ||
#include <string> | ||
#include <map> | ||
#include "tensorflow/core/framework/graph.pb.h" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
How could we maintain versioning of all this Tensorflow files?
I don't know if the list of TF protobuf files introduced it is minimal |
@edgarriba for compiling problems with .proto files, you can have a try for:
This is similar to my previous shell script for generating headers and sources from .proto files using protoc, you can find it Here |
@wangyida I know the existence of our script to generate the proto files, however I want to simplify things and do it from CMake as it's done with Caffe |
@edgarriba OK, let me have a check on CMakeList style, I just came back from Xiamen:) The current CMake checking strategy also have bugs. |
@wangyida oks. Feel free to commit in this branch |
@edgarriba I had a try on the graph brach with tensorflow model parser and find that there might be some problem generating headers and source files within cmake from subdirectory, it's declared officially there in cmake doc
|
So I think maybe it's also applicable to call shell command within cmakelist |
Cannot we add a CmakeList subdirectory file? What is the behaviour that we want on make install? |
I think that there are two possible cases for caffe/tensorflow converters:
For case 1) we can assume that they at the correct place so there's no problem. Regarding installation, if we behave in this way and we generate the proto files each time during the compilation we can avoid the mentioned problems. |
Ok so what is the subdirectory problem? |
As for the updating strategy of TensorFlow, the case should be case 2, only .proto files should be given into tiny-dnn. |
Ok but I don't fully understand the scope. We want a futher tensorflow_converter like caffe one so we have this linking dependencies only there.. or we want also in user apps? |
So the main issue is we want to use converters to reserialize models in tiny-dnn format? |
This converter is used for loading tf models and graphs stored in protobuf files, there is a parser in graph branch used for loading TF parametric model into memory. There are no API for reserializing Parametric models into tiny-dnn models currently even we have all graphical relationships and parameter values |
Yes I know but I am talking of the roadmap. Do we want to use for creating our standalone tool that produce serialized tiny-dnn models from TF or to work in memory with third-party developed apps? |
No description provided.