Not sure about poisonous varieties of fig but I wouldn't be surprised if there were some! I know (from experience...) that the white sap can make you extra sensitive to sunburn and that's the edible version. A bit of googling tells me that the edible species is all edible (but the sap can be a problem!) but as with anything you're not sure about, "if in doubt, leave it out".
Our home grown ones are from a 15+ year old (well, we planted it 15 years ago as a pot grown plant) tree planted against a South facing fence and produces a fair few fruits, although a fair number drop off before maturity and some get squirrelled or birded - any we get to eat are a nice bonus. Quite tasty but not as sweet as the ones we get in Crete. I should really tidy our tree up and train it better but never seem to get around to it.