Wouldnt it be better to join and extend existing libraries, like pytorch , tensorflow, and some others ?.
Then you could do IF nvidea hardware do this api call... if not manual python call
That way a lot of existing code could more easily adapt to it.
And Python stays a uniform language acros HW.